{ "cells": [ { "cell_type": "markdown", "id": "0b4fa576", "metadata": { "papermill": { "duration": 0.005949, "end_time": "2024-09-23T20:24:35.384144", "exception": false, "start_time": "2024-09-23T20:24:35.378195", "status": "completed" }, "tags": [] }, "source": [ "# Service API Example on Hartmann6\n", "\n", "The Ax Service API is designed to allow the user to control scheduling of trials and data computation while having an easy to use interface with Ax.\n", "\n", "The user iteratively:\n", "- Queries Ax for candidates\n", "- Schedules / deploys them however they choose\n", "- Computes data and logs to Ax\n", "- Repeat" ] }, { "cell_type": "code", "execution_count": 1, "id": "68ec2435", "metadata": { "execution": { "iopub.execute_input": "2024-09-23T20:24:35.396089Z", "iopub.status.busy": "2024-09-23T20:24:35.395746Z", "iopub.status.idle": "2024-09-23T20:24:39.175949Z", "shell.execute_reply": "2024-09-23T20:24:39.174937Z" }, "papermill": { "duration": 3.836676, "end_time": "2024-09-23T20:24:39.226085", "exception": false, "start_time": "2024-09-23T20:24:35.389409", "status": "completed" }, "tags": [] }, "outputs": [ { "data": { "text/html": [ "" ] }, "metadata": {}, "output_type": "display_data" }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 09-23 20:24:39] ax.utils.notebook.plotting: Injecting Plotly library into cell. Do not overwrite or delete cell.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 09-23 20:24:39] ax.utils.notebook.plotting: Please see\n", " (https://ax.dev/tutorials/visualizations.html#Fix-for-plots-that-are-not-rendering)\n", " if visualizations are not rendering.\n" ] }, { "data": { "text/html": [ " \n", " " ] }, "metadata": {}, "output_type": "display_data" } ], "source": [ "from ax.service.ax_client import AxClient, ObjectiveProperties\n", "from ax.utils.measurement.synthetic_functions import hartmann6\n", "from ax.utils.notebook.plotting import init_notebook_plotting, render\n", "\n", "init_notebook_plotting()" ] }, { "cell_type": "markdown", "id": "c39dce4a", "metadata": { "papermill": { "duration": 0.045906, "end_time": "2024-09-23T20:24:39.315901", "exception": false, "start_time": "2024-09-23T20:24:39.269995", "status": "completed" }, "tags": [] }, "source": [ "## 1. Initialize client\n", "\n", "Create a client object to interface with Ax APIs. By default this runs locally without storage." ] }, { "cell_type": "code", "execution_count": 2, "id": "fae3816f", "metadata": { "execution": { "iopub.execute_input": "2024-09-23T20:24:39.408824Z", "iopub.status.busy": "2024-09-23T20:24:39.408499Z", "iopub.status.idle": "2024-09-23T20:24:39.413073Z", "shell.execute_reply": "2024-09-23T20:24:39.412373Z" }, "papermill": { "duration": 0.053073, "end_time": "2024-09-23T20:24:39.414690", "exception": false, "start_time": "2024-09-23T20:24:39.361617", "status": "completed" }, "tags": [] }, "outputs": [ { "name": "stderr", "output_type": "stream", "text": [ "[INFO 09-23 20:24:39] ax.service.ax_client: Starting optimization with verbose logging. To disable logging, set the `verbose_logging` argument to `False`. Note that float values in the logs are rounded to 6 decimal points.\n" ] } ], "source": [ "ax_client = AxClient()" ] }, { "cell_type": "markdown", "id": "862f4b07", "metadata": { "papermill": { "duration": 0.045382, "end_time": "2024-09-23T20:24:39.506239", "exception": false, "start_time": "2024-09-23T20:24:39.460857", "status": "completed" }, "tags": [] }, "source": [ "## 2. Set up experiment\n", "An experiment consists of a **search space** (parameters and parameter constraints) and **optimization configuration** (objectives and outcome constraints). Note that:\n", "- Only `parameters`, and `objectives` arguments are required.\n", "- Dictionaries in `parameters` have the following required keys: \"name\" - parameter name, \"type\" - parameter type (\"range\", \"choice\" or \"fixed\"), \"bounds\" for range parameters, \"values\" for choice parameters, and \"value\" for fixed parameters.\n", "- Dictionaries in `parameters` can optionally include \"value_type\" (\"int\", \"float\", \"bool\" or \"str\"), \"log_scale\" flag for range parameters, and \"is_ordered\" flag for choice parameters.\n", "- `parameter_constraints` should be a list of strings of form \"p1 >= p2\" or \"p1 + p2 <= some_bound\".\n", "- `outcome_constraints` should be a list of strings of form \"constrained_metric <= some_bound\"." ] }, { "cell_type": "code", "execution_count": 3, "id": "703ecdcc", "metadata": { "execution": { "iopub.execute_input": "2024-09-23T20:24:39.599080Z", "iopub.status.busy": "2024-09-23T20:24:39.598556Z", "iopub.status.idle": "2024-09-23T20:24:39.611913Z", "shell.execute_reply": "2024-09-23T20:24:39.611241Z" }, "papermill": { "duration": 0.062812, "end_time": "2024-09-23T20:24:39.614382", "exception": false, "start_time": "2024-09-23T20:24:39.551570", "status": "completed" }, "tags": [] }, "outputs": [ { "name": "stderr", "output_type": "stream", "text": [ "[INFO 09-23 20:24:39] ax.service.utils.instantiation: Inferred value type of ParameterType.FLOAT for parameter x2. If that is not the expected value type, you can explicitly specify 'value_type' ('int', 'float', 'bool' or 'str') in parameter dict.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 09-23 20:24:39] ax.service.utils.instantiation: Inferred value type of ParameterType.FLOAT for parameter x3. If that is not the expected value type, you can explicitly specify 'value_type' ('int', 'float', 'bool' or 'str') in parameter dict.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 09-23 20:24:39] ax.service.utils.instantiation: Inferred value type of ParameterType.FLOAT for parameter x4. If that is not the expected value type, you can explicitly specify 'value_type' ('int', 'float', 'bool' or 'str') in parameter dict.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 09-23 20:24:39] ax.service.utils.instantiation: Inferred value type of ParameterType.FLOAT for parameter x5. If that is not the expected value type, you can explicitly specify 'value_type' ('int', 'float', 'bool' or 'str') in parameter dict.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 09-23 20:24:39] ax.service.utils.instantiation: Inferred value type of ParameterType.FLOAT for parameter x6. If that is not the expected value type, you can explicitly specify 'value_type' ('int', 'float', 'bool' or 'str') in parameter dict.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 09-23 20:24:39] ax.service.utils.instantiation: Created search space: SearchSpace(parameters=[RangeParameter(name='x1', parameter_type=FLOAT, range=[0.0, 1.0]), RangeParameter(name='x2', parameter_type=FLOAT, range=[0.0, 1.0]), RangeParameter(name='x3', parameter_type=FLOAT, range=[0.0, 1.0]), RangeParameter(name='x4', parameter_type=FLOAT, range=[0.0, 1.0]), RangeParameter(name='x5', parameter_type=FLOAT, range=[0.0, 1.0]), RangeParameter(name='x6', parameter_type=FLOAT, range=[0.0, 1.0])], parameter_constraints=[ParameterConstraint(1.0*x1 + 1.0*x2 <= 2.0)]).\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 09-23 20:24:39] ax.modelbridge.dispatch_utils: Using Models.BOTORCH_MODULAR since there is at least one ordered parameter and there are no unordered categorical parameters.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 09-23 20:24:39] ax.modelbridge.dispatch_utils: Calculating the number of remaining initialization trials based on num_initialization_trials=None max_initialization_trials=None num_tunable_parameters=6 num_trials=None use_batch_trials=False\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 09-23 20:24:39] ax.modelbridge.dispatch_utils: calculated num_initialization_trials=12\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 09-23 20:24:39] ax.modelbridge.dispatch_utils: num_completed_initialization_trials=0 num_remaining_initialization_trials=12\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 09-23 20:24:39] ax.modelbridge.dispatch_utils: `verbose`, `disable_progbar`, and `jit_compile` are not yet supported when using `choose_generation_strategy` with ModularBoTorchModel, dropping these arguments.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 09-23 20:24:39] ax.modelbridge.dispatch_utils: Using Bayesian Optimization generation strategy: GenerationStrategy(name='Sobol+BoTorch', steps=[Sobol for 12 trials, BoTorch for subsequent trials]). Iterations after 12 will take longer to generate due to model-fitting.\n" ] } ], "source": [ "ax_client.create_experiment(\n", " name=\"hartmann_test_experiment\",\n", " parameters=[\n", " {\n", " \"name\": \"x1\",\n", " \"type\": \"range\",\n", " \"bounds\": [0.0, 1.0],\n", " \"value_type\": \"float\", # Optional, defaults to inference from type of \"bounds\".\n", " \"log_scale\": False, # Optional, defaults to False.\n", " },\n", " {\n", " \"name\": \"x2\",\n", " \"type\": \"range\",\n", " \"bounds\": [0.0, 1.0],\n", " },\n", " {\n", " \"name\": \"x3\",\n", " \"type\": \"range\",\n", " \"bounds\": [0.0, 1.0],\n", " },\n", " {\n", " \"name\": \"x4\",\n", " \"type\": \"range\",\n", " \"bounds\": [0.0, 1.0],\n", " },\n", " {\n", " \"name\": \"x5\",\n", " \"type\": \"range\",\n", " \"bounds\": [0.0, 1.0],\n", " },\n", " {\n", " \"name\": \"x6\",\n", " \"type\": \"range\",\n", " \"bounds\": [0.0, 1.0],\n", " },\n", " ],\n", " objectives={\"hartmann6\": ObjectiveProperties(minimize=True)},\n", " parameter_constraints=[\"x1 + x2 <= 2.0\"], # Optional.\n", " outcome_constraints=[\"l2norm <= 1.25\"], # Optional.\n", ")" ] }, { "cell_type": "markdown", "id": "a8dc6fae", "metadata": { "papermill": { "duration": 0.046058, "end_time": "2024-09-23T20:24:39.706757", "exception": false, "start_time": "2024-09-23T20:24:39.660699", "status": "completed" }, "tags": [] }, "source": [ "## 3. Define how to evaluate trials\n", "When using Ax a service, evaluation of parameterizations suggested by Ax is done either locally or, more commonly, using an external scheduler. Below is a dummy evaluation function that outputs data for two metrics \"hartmann6\" and \"l2norm\". Note that all returned metrics correspond to either the `objectives` set on experiment creation or the metric names mentioned in `outcome_constraints`." ] }, { "cell_type": "code", "execution_count": 4, "id": "3ddbc30d", "metadata": { "execution": { "iopub.execute_input": "2024-09-23T20:24:39.801143Z", "iopub.status.busy": "2024-09-23T20:24:39.800544Z", "iopub.status.idle": "2024-09-23T20:24:39.804980Z", "shell.execute_reply": "2024-09-23T20:24:39.804253Z" }, "papermill": { "duration": 0.053384, "end_time": "2024-09-23T20:24:39.806276", "exception": false, "start_time": "2024-09-23T20:24:39.752892", "status": "completed" }, "tags": [] }, "outputs": [], "source": [ "import numpy as np\n", "\n", "\n", "def evaluate(parameterization):\n", " x = np.array([parameterization.get(f\"x{i+1}\") for i in range(6)])\n", " # In our case, standard error is 0, since we are computing a synthetic function.\n", " return {\"hartmann6\": (hartmann6(x), 0.0), \"l2norm\": (np.sqrt((x**2).sum()), 0.0)}" ] }, { "cell_type": "markdown", "id": "8b5c85ba", "metadata": { "papermill": { "duration": 0.046094, "end_time": "2024-09-23T20:24:39.898756", "exception": false, "start_time": "2024-09-23T20:24:39.852662", "status": "completed" }, "tags": [] }, "source": [ "Result of the evaluation should generally be a mapping of the format: `{metric_name -> (mean, SEM)}`. If there is only one metric in the experiment – the objective – then evaluation function can return a single tuple of mean and SEM, in which case Ax will assume that evaluation corresponds to the objective. _It can also return only the mean as a float, in which case Ax will treat SEM as unknown and use a model that can infer it._ \n", "\n", "For more details on evaluation function, refer to the \"Trial Evaluation\" section in the Ax docs at [ax.dev](https://ax.dev/)" ] }, { "cell_type": "markdown", "id": "873c504a", "metadata": { "papermill": { "duration": 0.045974, "end_time": "2024-09-23T20:24:39.990437", "exception": false, "start_time": "2024-09-23T20:24:39.944463", "status": "completed" }, "tags": [] }, "source": [ "## 4. Run optimization loop\n", "With the experiment set up, we can start the optimization loop.\n", "\n", "At each step, the user queries the client for a new trial then submits the evaluation of that trial back to the client.\n", "\n", "Note that Ax auto-selects an appropriate optimization algorithm based on the search space. For more advance use cases that require a specific optimization algorithm, pass a `generation_strategy` argument into the `AxClient` constructor. Note that when Bayesian Optimization is used, generating new trials may take a few minutes." ] }, { "cell_type": "code", "execution_count": 5, "id": "b98bf7de", "metadata": { "execution": { "iopub.execute_input": "2024-09-23T20:24:40.084394Z", "iopub.status.busy": "2024-09-23T20:24:40.083729Z", "iopub.status.idle": "2024-09-23T20:26:30.424059Z", "shell.execute_reply": "2024-09-23T20:26:30.423348Z" }, "papermill": { "duration": 110.389244, "end_time": "2024-09-23T20:26:30.425669", "exception": false, "start_time": "2024-09-23T20:24:40.036425", "status": "completed" }, "tags": [] }, "outputs": [ { "name": "stderr", "output_type": "stream", "text": [ "/tmp/tmp.QqcA7fo0ui/Ax-main/ax/modelbridge/cross_validation.py:463: UserWarning:\n", "\n", "Encountered exception in computing model fit quality: RandomModelBridge does not support prediction.\n", "\n", "[INFO 09-23 20:24:40] ax.service.ax_client: Generated new trial 0 with parameters {'x1': 0.454046, 'x2': 0.108311, 'x3': 0.480222, 'x4': 0.387449, 'x5': 0.357594, 'x6': 0.047044} using model Sobol.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 09-23 20:24:40] ax.service.ax_client: Completed trial 0 with data: {'hartmann6': (-0.132631, 0.0), 'l2norm': (0.853643, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "/tmp/tmp.QqcA7fo0ui/Ax-main/ax/modelbridge/cross_validation.py:463: UserWarning:\n", "\n", "Encountered exception in computing model fit quality: RandomModelBridge does not support prediction.\n", "\n", "[INFO 09-23 20:24:40] ax.service.ax_client: Generated new trial 1 with parameters {'x1': 0.787701, 'x2': 0.765017, 'x3': 0.983973, 'x4': 0.800578, 'x5': 0.69976, 'x6': 0.825102} using model Sobol.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 09-23 20:24:40] ax.service.ax_client: Completed trial 1 with data: {'hartmann6': (-0.00906, 0.0), 'l2norm': (1.996324, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "/tmp/tmp.QqcA7fo0ui/Ax-main/ax/modelbridge/cross_validation.py:463: UserWarning:\n", "\n", "Encountered exception in computing model fit quality: RandomModelBridge does not support prediction.\n", "\n", "[INFO 09-23 20:24:40] ax.service.ax_client: Generated new trial 2 with parameters {'x1': 0.599525, 'x2': 0.498112, 'x3': 0.058665, 'x4': 0.243652, 'x5': 0.752892, 'x6': 0.548049} using model Sobol.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 09-23 20:24:40] ax.service.ax_client: Completed trial 2 with data: {'hartmann6': (-0.037627, 0.0), 'l2norm': (1.239983, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "/tmp/tmp.QqcA7fo0ui/Ax-main/ax/modelbridge/cross_validation.py:463: UserWarning:\n", "\n", "Encountered exception in computing model fit quality: RandomModelBridge does not support prediction.\n", "\n", "[INFO 09-23 20:24:40] ax.service.ax_client: Generated new trial 3 with parameters {'x1': 0.144057, 'x2': 0.655855, 'x3': 0.554914, 'x4': 0.568398, 'x5': 0.156581, 'x6': 0.326143} using model Sobol.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 09-23 20:24:40] ax.service.ax_client: Completed trial 3 with data: {'hartmann6': (-0.390073, 0.0), 'l2norm': (1.101268, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "/tmp/tmp.QqcA7fo0ui/Ax-main/ax/modelbridge/cross_validation.py:463: UserWarning:\n", "\n", "Encountered exception in computing model fit quality: RandomModelBridge does not support prediction.\n", "\n", "[INFO 09-23 20:24:40] ax.service.ax_client: Generated new trial 4 with parameters {'x1': 0.073112, 'x2': 0.294861, 'x3': 0.818363, 'x4': 0.644828, 'x5': 0.124673, 'x6': 0.227329} using model Sobol.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 09-23 20:24:40] ax.service.ax_client: Completed trial 4 with data: {'hartmann6': (-0.090844, 0.0), 'l2norm': (1.11581, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "/tmp/tmp.QqcA7fo0ui/Ax-main/ax/modelbridge/cross_validation.py:463: UserWarning:\n", "\n", "Encountered exception in computing model fit quality: RandomModelBridge does not support prediction.\n", "\n", "[INFO 09-23 20:24:40] ax.service.ax_client: Generated new trial 5 with parameters {'x1': 0.684294, 'x2': 0.574683, 'x3': 0.314609, 'x4': 0.042208, 'x5': 0.965861, 'x6': 0.894543} using model Sobol.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 09-23 20:24:40] ax.service.ax_client: Completed trial 5 with data: {'hartmann6': (-0.00503, 0.0), 'l2norm': (1.62246, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "/tmp/tmp.QqcA7fo0ui/Ax-main/ax/modelbridge/cross_validation.py:463: UserWarning:\n", "\n", "Encountered exception in computing model fit quality: RandomModelBridge does not support prediction.\n", "\n", "[INFO 09-23 20:24:40] ax.service.ax_client: Generated new trial 6 with parameters {'x1': 0.999776, 'x2': 0.184601, 'x3': 0.642261, 'x4': 0.970265, 'x5': 0.518987, 'x6': 0.72836} using model Sobol.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 09-23 20:24:40] ax.service.ax_client: Completed trial 6 with data: {'hartmann6': (-0.03403, 0.0), 'l2norm': (1.785328, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "/tmp/tmp.QqcA7fo0ui/Ax-main/ax/modelbridge/cross_validation.py:463: UserWarning:\n", "\n", "Encountered exception in computing model fit quality: RandomModelBridge does not support prediction.\n", "\n", "[INFO 09-23 20:24:40] ax.service.ax_client: Generated new trial 7 with parameters {'x1': 0.259457, 'x2': 0.965338, 'x3': 0.146016, 'x4': 0.342746, 'x5': 0.423651, 'x6': 0.395618} using model Sobol.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 09-23 20:24:40] ax.service.ax_client: Completed trial 7 with data: {'hartmann6': (-0.315192, 0.0), 'l2norm': (1.214078, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "/tmp/tmp.QqcA7fo0ui/Ax-main/ax/modelbridge/cross_validation.py:463: UserWarning:\n", "\n", "Encountered exception in computing model fit quality: RandomModelBridge does not support prediction.\n", "\n", "[INFO 09-23 20:24:40] ax.service.ax_client: Generated new trial 8 with parameters {'x1': 0.318785, 'x2': 0.398165, 'x3': 0.737564, 'x4': 0.074604, 'x5': 0.671853, 'x6': 0.302765} using model Sobol.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 09-23 20:24:40] ax.service.ax_client: Completed trial 8 with data: {'hartmann6': (-0.223803, 0.0), 'l2norm': (1.16309, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "/tmp/tmp.QqcA7fo0ui/Ax-main/ax/modelbridge/cross_validation.py:463: UserWarning:\n", "\n", "Encountered exception in computing model fit quality: RandomModelBridge does not support prediction.\n", "\n", "[INFO 09-23 20:24:40] ax.service.ax_client: Generated new trial 9 with parameters {'x1': 0.921897, 'x2': 0.740425, 'x3': 0.241616, 'x4': 0.737369, 'x5': 0.263042, 'x6': 0.573013} using model Sobol.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 09-23 20:24:40] ax.service.ax_client: Completed trial 9 with data: {'hartmann6': (-0.025379, 0.0), 'l2norm': (1.548467, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "/tmp/tmp.QqcA7fo0ui/Ax-main/ax/modelbridge/cross_validation.py:463: UserWarning:\n", "\n", "Encountered exception in computing model fit quality: RandomModelBridge does not support prediction.\n", "\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 09-23 20:24:40] ax.service.ax_client: Generated new trial 10 with parameters {'x1': 0.737759, 'x2': 0.007082, 'x3': 0.786064, 'x4': 0.306296, 'x5': 0.190556, 'x6': 0.803802} using model Sobol.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 09-23 20:24:40] ax.service.ax_client: Completed trial 10 with data: {'hartmann6': (-0.776245, 0.0), 'l2norm': (1.392287, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "/tmp/tmp.QqcA7fo0ui/Ax-main/ax/modelbridge/cross_validation.py:463: UserWarning:\n", "\n", "Encountered exception in computing model fit quality: RandomModelBridge does not support prediction.\n", "\n", "[INFO 09-23 20:24:40] ax.service.ax_client: Generated new trial 11 with parameters {'x1': 0.004995, 'x2': 0.85038, 'x3': 0.282013, 'x4': 0.881654, 'x5': 0.845222, 'x6': 0.074082} using model Sobol.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 09-23 20:24:40] ax.service.ax_client: Completed trial 11 with data: {'hartmann6': (-0.075101, 0.0), 'l2norm': (1.516544, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 09-23 20:24:49] ax.service.ax_client: Generated new trial 12 with parameters {'x1': 0.666759, 'x2': 0.0, 'x3': 0.609346, 'x4': 0.263247, 'x5': 0.142119, 'x6': 0.680478} using model BoTorch.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 09-23 20:24:49] ax.service.ax_client: Completed trial 12 with data: {'hartmann6': (-0.939485, 0.0), 'l2norm': (1.169793, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 09-23 20:24:56] ax.service.ax_client: Generated new trial 13 with parameters {'x1': 0.41096, 'x2': 0.240627, 'x3': 0.582696, 'x4': 0.235564, 'x5': 0.038163, 'x6': 0.657492} using model BoTorch.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 09-23 20:24:56] ax.service.ax_client: Completed trial 13 with data: {'hartmann6': (-0.886529, 0.0), 'l2norm': (1.027408, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 09-23 20:25:04] ax.service.ax_client: Generated new trial 14 with parameters {'x1': 0.739039, 'x2': 0.0, 'x3': 0.644439, 'x4': 0.193962, 'x5': 0.108279, 'x6': 0.576811} using model BoTorch.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 09-23 20:25:04] ax.service.ax_client: Completed trial 14 with data: {'hartmann6': (-0.518645, 0.0), 'l2norm': (1.15911, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 09-23 20:25:10] ax.service.ax_client: Generated new trial 15 with parameters {'x1': 0.543757, 'x2': 0.0, 'x3': 0.681759, 'x4': 0.205896, 'x5': 0.001625, 'x6': 0.722285} using model BoTorch.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 09-23 20:25:10] ax.service.ax_client: Completed trial 15 with data: {'hartmann6': (-0.40956, 0.0), 'l2norm': (1.150894, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 09-23 20:25:20] ax.service.ax_client: Generated new trial 16 with parameters {'x1': 0.500097, 'x2': 0.267751, 'x3': 0.526442, 'x4': 0.265153, 'x5': 0.131498, 'x6': 0.618959} using model BoTorch.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 09-23 20:25:20] ax.service.ax_client: Completed trial 16 with data: {'hartmann6': (-1.397179, 0.0), 'l2norm': (1.034232, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 09-23 20:25:28] ax.service.ax_client: Generated new trial 17 with parameters {'x1': 0.439871, 'x2': 0.414979, 'x3': 0.475938, 'x4': 0.281682, 'x5': 0.161137, 'x6': 0.705005} using model BoTorch.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 09-23 20:25:28] ax.service.ax_client: Completed trial 17 with data: {'hartmann6': (-1.523282, 0.0), 'l2norm': (1.092956, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 09-23 20:25:38] ax.service.ax_client: Generated new trial 18 with parameters {'x1': 0.447995, 'x2': 0.556936, 'x3': 0.414816, 'x4': 0.034401, 'x5': 0.172525, 'x6': 0.750583} using model BoTorch.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 09-23 20:25:38] ax.service.ax_client: Completed trial 18 with data: {'hartmann6': (-0.613431, 0.0), 'l2norm': (1.130165, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 09-23 20:25:46] ax.service.ax_client: Generated new trial 19 with parameters {'x1': 0.448578, 'x2': 0.670713, 'x3': 0.234594, 'x4': 0.317399, 'x5': 0.144899, 'x6': 0.576569} using model BoTorch.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 09-23 20:25:46] ax.service.ax_client: Completed trial 19 with data: {'hartmann6': (-0.614793, 0.0), 'l2norm': (1.077164, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 09-23 20:25:55] ax.service.ax_client: Generated new trial 20 with parameters {'x1': 0.407511, 'x2': 0.352, 'x3': 0.556047, 'x4': 0.306292, 'x5': 0.182656, 'x6': 0.761713} using model BoTorch.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 09-23 20:25:55] ax.service.ax_client: Completed trial 20 with data: {'hartmann6': (-1.838459, 0.0), 'l2norm': (1.143041, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 09-23 20:26:04] ax.service.ax_client: Generated new trial 21 with parameters {'x1': 0.363382, 'x2': 0.256764, 'x3': 0.648063, 'x4': 0.334966, 'x5': 0.206714, 'x6': 0.817846} using model BoTorch.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 09-23 20:26:04] ax.service.ax_client: Completed trial 21 with data: {'hartmann6': (-2.047507, 0.0), 'l2norm': (1.200735, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 09-23 20:26:11] ax.service.ax_client: Generated new trial 22 with parameters {'x1': 0.330941, 'x2': 0.187409, 'x3': 0.414243, 'x4': 0.36021, 'x5': 0.226291, 'x6': 0.84542} using model BoTorch.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 09-23 20:26:11] ax.service.ax_client: Completed trial 22 with data: {'hartmann6': (-2.022039, 0.0), 'l2norm': (1.10088, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 09-23 20:26:20] ax.service.ax_client: Generated new trial 23 with parameters {'x1': 0.34987, 'x2': 0.246853, 'x3': 0.513527, 'x4': 0.421378, 'x5': 0.188439, 'x6': 0.920897} using model BoTorch.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 09-23 20:26:20] ax.service.ax_client: Completed trial 23 with data: {'hartmann6': (-1.258193, 0.0), 'l2norm': (1.228078, 0.0)}.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 09-23 20:26:30] ax.service.ax_client: Generated new trial 24 with parameters {'x1': 0.292249, 'x2': 0.16486, 'x3': 0.604895, 'x4': 0.280001, 'x5': 0.258435, 'x6': 0.755642} using model BoTorch.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 09-23 20:26:30] ax.service.ax_client: Completed trial 24 with data: {'hartmann6': (-2.764157, 0.0), 'l2norm': (1.093009, 0.0)}.\n" ] } ], "source": [ "for i in range(25):\n", " parameterization, trial_index = ax_client.get_next_trial()\n", " # Local evaluation here can be replaced with deployment to external system.\n", " ax_client.complete_trial(trial_index=trial_index, raw_data=evaluate(parameterization))" ] }, { "cell_type": "markdown", "id": "0f798a5f", "metadata": { "papermill": { "duration": 0.057627, "end_time": "2024-09-23T20:26:30.541888", "exception": false, "start_time": "2024-09-23T20:26:30.484261", "status": "completed" }, "tags": [] }, "source": [ "### How many trials can run in parallel?\n", "By default, Ax restricts number of trials that can run in parallel for some optimization stages, in order to improve the optimization performance and reduce the number of trials that the optimization will require. To check the maximum parallelism for each optimization stage:" ] }, { "cell_type": "code", "execution_count": 6, "id": "95b088b7", "metadata": { "execution": { "iopub.execute_input": "2024-09-23T20:26:30.658733Z", "iopub.status.busy": "2024-09-23T20:26:30.658222Z", "iopub.status.idle": "2024-09-23T20:26:30.665247Z", "shell.execute_reply": "2024-09-23T20:26:30.664634Z" }, "papermill": { "duration": 0.066961, "end_time": "2024-09-23T20:26:30.666544", "exception": false, "start_time": "2024-09-23T20:26:30.599583", "status": "completed" }, "tags": [] }, "outputs": [ { "data": { "text/plain": [ "[(12, 12), (-1, 3)]" ] }, "execution_count": 6, "metadata": {}, "output_type": "execute_result" } ], "source": [ "ax_client.get_max_parallelism()" ] }, { "cell_type": "markdown", "id": "59867a98", "metadata": { "papermill": { "duration": 0.057324, "end_time": "2024-09-23T20:26:30.782745", "exception": false, "start_time": "2024-09-23T20:26:30.725421", "status": "completed" }, "tags": [] }, "source": [ "The output of this function is a list of tuples of form (number of trials, max parallelism), so the example above means \"the max parallelism is 12 for the first 12 trials and 3 for all subsequent trials.\" This is because the first 12 trials are produced quasi-randomly and can all be evaluated at once, and subsequent trials are produced via Bayesian optimization, which converges on optimal point in fewer trials when parallelism is limited. `MaxParallelismReachedException` indicates that the parallelism limit has been reached –– refer to the 'Service API Exceptions Meaning and Handling' section at the end of the tutorial for handling." ] }, { "cell_type": "markdown", "id": "8163e017", "metadata": { "papermill": { "duration": 0.054123, "end_time": "2024-09-23T20:26:30.892398", "exception": false, "start_time": "2024-09-23T20:26:30.838275", "status": "completed" }, "tags": [] }, "source": [ "### How to view all existing trials during optimization?" ] }, { "cell_type": "code", "execution_count": 7, "id": "8b395d3c", "metadata": { "execution": { "iopub.execute_input": "2024-09-23T20:26:31.002116Z", "iopub.status.busy": "2024-09-23T20:26:31.001479Z", "iopub.status.idle": "2024-09-23T20:26:31.029686Z", "shell.execute_reply": "2024-09-23T20:26:31.029116Z" }, "papermill": { "duration": 0.084433, "end_time": "2024-09-23T20:26:31.030942", "exception": false, "start_time": "2024-09-23T20:26:30.946509", "status": "completed" }, "tags": [] }, "outputs": [ { "name": "stderr", "output_type": "stream", "text": [ "[INFO 09-23 20:26:31] ax.modelbridge.generation_strategy: Note that parameter values in dataframe are rounded to 2 decimal points; the values in the dataframe are thus not the exact ones suggested by Ax in trials.\n" ] }, { "data": { "text/html": [ "
\n", "\n", "\n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", " \n", "
Generation StepGeneration Model(s)Trial IndexTrial StatusArm Parameterizations
0[GenerationStep_0][Sobol]0COMPLETED{'0_0': {'x1': 0.45, 'x2': 0.11, 'x3': 0.48, '...
1[GenerationStep_0][Sobol]1COMPLETED{'1_0': {'x1': 0.79, 'x2': 0.77, 'x3': 0.98, '...
2[GenerationStep_0][Sobol]2COMPLETED{'2_0': {'x1': 0.6, 'x2': 0.5, 'x3': 0.06, 'x4...
3[GenerationStep_0][Sobol]3COMPLETED{'3_0': {'x1': 0.14, 'x2': 0.66, 'x3': 0.55, '...
4[GenerationStep_0][Sobol]4COMPLETED{'4_0': {'x1': 0.07, 'x2': 0.29, 'x3': 0.82, '...
5[GenerationStep_0][Sobol]5COMPLETED{'5_0': {'x1': 0.68, 'x2': 0.57, 'x3': 0.31, '...
6[GenerationStep_0][Sobol]6COMPLETED{'6_0': {'x1': 1.0, 'x2': 0.18, 'x3': 0.64, 'x...
7[GenerationStep_0][Sobol]7COMPLETED{'7_0': {'x1': 0.26, 'x2': 0.97, 'x3': 0.15, '...
8[GenerationStep_0][Sobol]8COMPLETED{'8_0': {'x1': 0.32, 'x2': 0.4, 'x3': 0.74, 'x...
9[GenerationStep_0][Sobol]9COMPLETED{'9_0': {'x1': 0.92, 'x2': 0.74, 'x3': 0.24, '...
10[GenerationStep_0][Sobol]10COMPLETED{'10_0': {'x1': 0.74, 'x2': 0.01, 'x3': 0.79, ...
11[GenerationStep_0][Sobol]11COMPLETED{'11_0': {'x1': 0.0, 'x2': 0.85, 'x3': 0.28, '...
12[GenerationStep_1][BoTorch]12COMPLETED{'12_0': {'x1': 0.67, 'x2': 0.0, 'x3': 0.61, '...
13[GenerationStep_1][BoTorch]13COMPLETED{'13_0': {'x1': 0.41, 'x2': 0.24, 'x3': 0.58, ...
14[GenerationStep_1][BoTorch]14COMPLETED{'14_0': {'x1': 0.74, 'x2': 0.0, 'x3': 0.64, '...
15[GenerationStep_1][BoTorch]15COMPLETED{'15_0': {'x1': 0.54, 'x2': 0.0, 'x3': 0.68, '...
16[GenerationStep_1][BoTorch]16COMPLETED{'16_0': {'x1': 0.5, 'x2': 0.27, 'x3': 0.53, '...
17[GenerationStep_1][BoTorch]17COMPLETED{'17_0': {'x1': 0.44, 'x2': 0.41, 'x3': 0.48, ...
18[GenerationStep_1][BoTorch]18COMPLETED{'18_0': {'x1': 0.45, 'x2': 0.56, 'x3': 0.41, ...
19[GenerationStep_1][BoTorch]19COMPLETED{'19_0': {'x1': 0.45, 'x2': 0.67, 'x3': 0.23, ...
20[GenerationStep_1][BoTorch]20COMPLETED{'20_0': {'x1': 0.41, 'x2': 0.35, 'x3': 0.56, ...
21[GenerationStep_1][BoTorch]21COMPLETED{'21_0': {'x1': 0.36, 'x2': 0.26, 'x3': 0.65, ...
22[GenerationStep_1][BoTorch]22COMPLETED{'22_0': {'x1': 0.33, 'x2': 0.19, 'x3': 0.41, ...
23[GenerationStep_1][BoTorch]23COMPLETED{'23_0': {'x1': 0.35, 'x2': 0.25, 'x3': 0.51, ...
24[GenerationStep_1][BoTorch]24COMPLETED{'24_0': {'x1': 0.29, 'x2': 0.16, 'x3': 0.6, '...
\n", "
" ], "text/plain": [ " Generation Step Generation Model(s) Trial Index Trial Status \\\n", "0 [GenerationStep_0] [Sobol] 0 COMPLETED \n", "1 [GenerationStep_0] [Sobol] 1 COMPLETED \n", "2 [GenerationStep_0] [Sobol] 2 COMPLETED \n", "3 [GenerationStep_0] [Sobol] 3 COMPLETED \n", "4 [GenerationStep_0] [Sobol] 4 COMPLETED \n", "5 [GenerationStep_0] [Sobol] 5 COMPLETED \n", "6 [GenerationStep_0] [Sobol] 6 COMPLETED \n", "7 [GenerationStep_0] [Sobol] 7 COMPLETED \n", "8 [GenerationStep_0] [Sobol] 8 COMPLETED \n", "9 [GenerationStep_0] [Sobol] 9 COMPLETED \n", "10 [GenerationStep_0] [Sobol] 10 COMPLETED \n", "11 [GenerationStep_0] [Sobol] 11 COMPLETED \n", "12 [GenerationStep_1] [BoTorch] 12 COMPLETED \n", "13 [GenerationStep_1] [BoTorch] 13 COMPLETED \n", "14 [GenerationStep_1] [BoTorch] 14 COMPLETED \n", "15 [GenerationStep_1] [BoTorch] 15 COMPLETED \n", "16 [GenerationStep_1] [BoTorch] 16 COMPLETED \n", "17 [GenerationStep_1] [BoTorch] 17 COMPLETED \n", "18 [GenerationStep_1] [BoTorch] 18 COMPLETED \n", "19 [GenerationStep_1] [BoTorch] 19 COMPLETED \n", "20 [GenerationStep_1] [BoTorch] 20 COMPLETED \n", "21 [GenerationStep_1] [BoTorch] 21 COMPLETED \n", "22 [GenerationStep_1] [BoTorch] 22 COMPLETED \n", "23 [GenerationStep_1] [BoTorch] 23 COMPLETED \n", "24 [GenerationStep_1] [BoTorch] 24 COMPLETED \n", "\n", " Arm Parameterizations \n", "0 {'0_0': {'x1': 0.45, 'x2': 0.11, 'x3': 0.48, '... \n", "1 {'1_0': {'x1': 0.79, 'x2': 0.77, 'x3': 0.98, '... \n", "2 {'2_0': {'x1': 0.6, 'x2': 0.5, 'x3': 0.06, 'x4... \n", "3 {'3_0': {'x1': 0.14, 'x2': 0.66, 'x3': 0.55, '... \n", "4 {'4_0': {'x1': 0.07, 'x2': 0.29, 'x3': 0.82, '... \n", "5 {'5_0': {'x1': 0.68, 'x2': 0.57, 'x3': 0.31, '... \n", "6 {'6_0': {'x1': 1.0, 'x2': 0.18, 'x3': 0.64, 'x... \n", "7 {'7_0': {'x1': 0.26, 'x2': 0.97, 'x3': 0.15, '... \n", "8 {'8_0': {'x1': 0.32, 'x2': 0.4, 'x3': 0.74, 'x... \n", "9 {'9_0': {'x1': 0.92, 'x2': 0.74, 'x3': 0.24, '... \n", "10 {'10_0': {'x1': 0.74, 'x2': 0.01, 'x3': 0.79, ... \n", "11 {'11_0': {'x1': 0.0, 'x2': 0.85, 'x3': 0.28, '... \n", "12 {'12_0': {'x1': 0.67, 'x2': 0.0, 'x3': 0.61, '... \n", "13 {'13_0': {'x1': 0.41, 'x2': 0.24, 'x3': 0.58, ... \n", "14 {'14_0': {'x1': 0.74, 'x2': 0.0, 'x3': 0.64, '... \n", "15 {'15_0': {'x1': 0.54, 'x2': 0.0, 'x3': 0.68, '... \n", "16 {'16_0': {'x1': 0.5, 'x2': 0.27, 'x3': 0.53, '... \n", "17 {'17_0': {'x1': 0.44, 'x2': 0.41, 'x3': 0.48, ... \n", "18 {'18_0': {'x1': 0.45, 'x2': 0.56, 'x3': 0.41, ... \n", "19 {'19_0': {'x1': 0.45, 'x2': 0.67, 'x3': 0.23, ... \n", "20 {'20_0': {'x1': 0.41, 'x2': 0.35, 'x3': 0.56, ... \n", "21 {'21_0': {'x1': 0.36, 'x2': 0.26, 'x3': 0.65, ... \n", "22 {'22_0': {'x1': 0.33, 'x2': 0.19, 'x3': 0.41, ... \n", "23 {'23_0': {'x1': 0.35, 'x2': 0.25, 'x3': 0.51, ... \n", "24 {'24_0': {'x1': 0.29, 'x2': 0.16, 'x3': 0.6, '... " ] }, "execution_count": 7, "metadata": {}, "output_type": "execute_result" } ], "source": [ "ax_client.generation_strategy.trials_as_df" ] }, { "cell_type": "markdown", "id": "7826ca6d", "metadata": { "papermill": { "duration": 0.054053, "end_time": "2024-09-23T20:26:31.140067", "exception": false, "start_time": "2024-09-23T20:26:31.086014", "status": "completed" }, "tags": [] }, "source": [ "## 5. Retrieve best parameters\n", "\n", "Once it's complete, we can access the best parameters found, as well as the corresponding metric values." ] }, { "cell_type": "code", "execution_count": 8, "id": "42718263", "metadata": { "execution": { "iopub.execute_input": "2024-09-23T20:26:31.251223Z", "iopub.status.busy": "2024-09-23T20:26:31.250929Z", "iopub.status.idle": "2024-09-23T20:26:31.601834Z", "shell.execute_reply": "2024-09-23T20:26:31.600927Z" }, "papermill": { "duration": 0.410095, "end_time": "2024-09-23T20:26:31.604719", "exception": false, "start_time": "2024-09-23T20:26:31.194624", "status": "completed" }, "tags": [] }, "outputs": [ { "data": { "text/plain": [ "{'x1': 0.2922492680470685,\n", " 'x2': 0.1648603758054338,\n", " 'x3': 0.6048947574293929,\n", " 'x4': 0.28000064986759804,\n", " 'x5': 0.258434664163761,\n", " 'x6': 0.7556418914202201}" ] }, "execution_count": 8, "metadata": {}, "output_type": "execute_result" } ], "source": [ "best_parameters, values = ax_client.get_best_parameters()\n", "best_parameters" ] }, { "cell_type": "code", "execution_count": 9, "id": "8c42dd7d", "metadata": { "execution": { "iopub.execute_input": "2024-09-23T20:26:31.754657Z", "iopub.status.busy": "2024-09-23T20:26:31.754283Z", "iopub.status.idle": "2024-09-23T20:26:31.758759Z", "shell.execute_reply": "2024-09-23T20:26:31.758200Z" }, "papermill": { "duration": 0.067235, "end_time": "2024-09-23T20:26:31.760012", "exception": false, "start_time": "2024-09-23T20:26:31.692777", "status": "completed" }, "tags": [] }, "outputs": [ { "data": { "text/plain": [ "{'hartmann6': -2.7641502246739904, 'l2norm': 1.0930102261039059}" ] }, "execution_count": 9, "metadata": {}, "output_type": "execute_result" } ], "source": [ "means, covariances = values\n", "means" ] }, { "cell_type": "markdown", "id": "15ac6e86", "metadata": { "papermill": { "duration": 0.053939, "end_time": "2024-09-23T20:26:31.871831", "exception": false, "start_time": "2024-09-23T20:26:31.817892", "status": "completed" }, "tags": [] }, "source": [ "For comparison, Hartmann6 minimum:" ] }, { "cell_type": "code", "execution_count": 10, "id": "d6d30451", "metadata": { "execution": { "iopub.execute_input": "2024-09-23T20:26:31.980806Z", "iopub.status.busy": "2024-09-23T20:26:31.980319Z", "iopub.status.idle": "2024-09-23T20:26:31.984928Z", "shell.execute_reply": "2024-09-23T20:26:31.984262Z" }, "papermill": { "duration": 0.060638, "end_time": "2024-09-23T20:26:31.986227", "exception": false, "start_time": "2024-09-23T20:26:31.925589", "status": "completed" }, "tags": [] }, "outputs": [ { "data": { "text/plain": [ "-3.32237" ] }, "execution_count": 10, "metadata": {}, "output_type": "execute_result" } ], "source": [ "hartmann6.fmin" ] }, { "cell_type": "markdown", "id": "b2a8c1e0", "metadata": { "papermill": { "duration": 0.053528, "end_time": "2024-09-23T20:26:32.093926", "exception": false, "start_time": "2024-09-23T20:26:32.040398", "status": "completed" }, "tags": [] }, "source": [ "## 6. Plot the response surface and optimization trace\n", "Here we arbitrarily select \"x1\" and \"x2\" as the two parameters to plot for both metrics, \"hartmann6\" and \"l2norm\"." ] }, { "cell_type": "code", "execution_count": 11, "id": "4543b188", "metadata": { "execution": { "iopub.execute_input": "2024-09-23T20:26:32.203778Z", "iopub.status.busy": "2024-09-23T20:26:32.203302Z", "iopub.status.idle": "2024-09-23T20:26:32.891429Z", "shell.execute_reply": "2024-09-23T20:26:32.890719Z" }, "papermill": { "duration": 0.746538, "end_time": "2024-09-23T20:26:32.894447", "exception": false, "start_time": "2024-09-23T20:26:32.147909", "status": "completed" }, "tags": [] }, "outputs": [ { "name": "stderr", "output_type": "stream", "text": [ "[INFO 09-23 20:26:32] ax.service.ax_client: Retrieving contour plot with parameter 'x1' on X-axis and 'x2' on Y-axis, for metric 'hartmann6'. Remaining parameters are affixed to the middle of their range.\n" ] }, { "data": { "application/vnd.plotly.v1+json": { "config": { "linkText": "Export to plot.ly", "plotlyServerURL": "https://plot.ly", "showLink": false }, "data": [ { "autocolorscale": false, "autocontour": true, "colorbar": { "tickfont": { "size": 8 }, "ticksuffix": "", "x": 0.45, "y": 0.5 }, "colorscale": [ [ 0.0, "rgb(247,252,253)" ], [ 0.125, "rgb(229,245,249)" ], [ 0.25, "rgb(204,236,230)" ], [ 0.375, "rgb(153,216,201)" ], [ 0.5, "rgb(102,194,164)" ], [ 0.625, "rgb(65,174,118)" ], [ 0.75, "rgb(35,139,69)" ], [ 0.875, "rgb(0,109,44)" ], [ 1.0, "rgb(0,68,27)" ] ], "contours": { "coloring": "heatmap" }, "hoverinfo": "x+y+z", "ncontours": 25, "type": "contour", "x": [ 0.0, 0.02040816326530612, 0.04081632653061224, 0.061224489795918366, 0.08163265306122448, 0.1020408163265306, 0.12244897959183673, 0.14285714285714285, 0.16326530612244897, 0.18367346938775508, 0.2040816326530612, 0.22448979591836732, 0.24489795918367346, 0.26530612244897955, 0.2857142857142857, 0.3061224489795918, 0.32653061224489793, 0.3469387755102041, 0.36734693877551017, 0.3877551020408163, 0.4081632653061224, 0.42857142857142855, 0.44897959183673464, 0.4693877551020408, 0.4897959183673469, 0.5102040816326531, 0.5306122448979591, 0.5510204081632653, 0.5714285714285714, 0.5918367346938775, 0.6122448979591836, 0.6326530612244897, 0.6530612244897959, 0.673469387755102, 0.6938775510204082, 0.7142857142857142, 0.7346938775510203, 0.7551020408163265, 0.7755102040816326, 0.7959183673469387, 0.8163265306122448, 0.836734693877551, 0.8571428571428571, 0.8775510204081632, 0.8979591836734693, 0.9183673469387754, 0.9387755102040816, 0.9591836734693877, 0.9795918367346939, 1.0 ], "xaxis": "x", "y": [ 0.0, 0.02040816326530612, 0.04081632653061224, 0.061224489795918366, 0.08163265306122448, 0.1020408163265306, 0.12244897959183673, 0.14285714285714285, 0.16326530612244897, 0.18367346938775508, 0.2040816326530612, 0.22448979591836732, 0.24489795918367346, 0.26530612244897955, 0.2857142857142857, 0.3061224489795918, 0.32653061224489793, 0.3469387755102041, 0.36734693877551017, 0.3877551020408163, 0.4081632653061224, 0.42857142857142855, 0.44897959183673464, 0.4693877551020408, 0.4897959183673469, 0.5102040816326531, 0.5306122448979591, 0.5510204081632653, 0.5714285714285714, 0.5918367346938775, 0.6122448979591836, 0.6326530612244897, 0.6530612244897959, 0.673469387755102, 0.6938775510204082, 0.7142857142857142, 0.7346938775510203, 0.7551020408163265, 0.7755102040816326, 0.7959183673469387, 0.8163265306122448, 0.836734693877551, 0.8571428571428571, 0.8775510204081632, 0.8979591836734693, 0.9183673469387754, 0.9387755102040816, 0.9591836734693877, 0.9795918367346939, 1.0 ], "yaxis": "y", "z": [ [ -1.2562041218641786, -1.3069781870360109, -1.356221271115769, -1.4035446706463561, -1.4485584712365462, -1.4908762208508803, -1.5301197763394736, -1.565924245910234, -1.597942944727577, -1.625852276958432, -1.6493564555497384, -1.6681919709385762, -1.682131721843233, -1.6909887252839872, -1.6946193290013423, -1.6929258573851684, -1.685858631751871, -1.6734173171058397, -1.6556515601449118, -1.6326608969237197, -1.6045939229461355, -1.5716467331657316, -1.5340606540647856, -1.4921193042868806, -1.4461450338534902, -1.3964948044564773, -1.343555584371872, -1.2877393409092475, -1.2294777207666772, -1.1692165140283228, -1.1074100007037182, -1.0445152796102528, -0.9809866780510114, -0.9172703372090678, -0.8537990625947529, -0.7909875214266078, -0.7292278597289718, -0.6688858014581579, -0.610297280423878, -0.5537656434723955, -0.4995594506728973, -0.4479108854288433, -0.3990147748424183, -0.35302820859466544, -0.31007073334167123, -0.27022508940966183, -0.23353844760087733, -0.20002409635602847, -0.16966352347005764, -0.14240883209115307 ], [ -1.274462894361692, -1.3260059233438035, -1.3759957153875115, -1.4240385137472111, -1.4697393921514903, -1.512706985758454, -1.5525583959247053, -1.5889241905291034, -1.6214534160518024, -1.6498185337452043, -1.673720190218199, -1.6928917327154982, -1.7071033813860004, -1.7161659749197862, -1.7199342120559107, -1.718309319528641, -1.7112410868763548, -1.6987292199795059, -1.6808239779669152, -1.6576260719361224, -1.6292858184419963, -1.5960015555619544, -1.5580173441757568, -1.5156199915286062, -1.4691354478130751, -1.4189246390612562, -1.3653788107667686, -1.3089144660794483, -1.2499679899037774, -1.1889900556098603, -1.1264399142171448, -1.0627796667821485, -0.998468619321959, -0.9339578160067341, -0.8696848406877753, -0.8060689692776084, -0.7435067462971849, -0.6823680483244637, -0.622992685420033, -0.565687579191659, -0.5107245433232936, -0.4583386794679606, -0.4087273887109417, -0.3620499866539843, -0.31842789882938144, -0.27794540286739006, -0.24065087481421726, -0.2065584893892335, -0.17565031789155983, -0.14787876298242963 ], [ -1.290948112375205, -1.3431696107814681, -1.3938170152520226, -1.442492158816199, -1.4887957609293365, -1.5323322087854283, -1.5727145125367668, -1.60956935531545, -1.6425421534020312, -1.6713020380327777, -1.6955466683511629, -1.7150067850180128, -1.7294504160734387, -1.738686650812541, -1.7425689036576624, -1.7409975981860664, -1.7339222114490067, -1.7213426302876165, -1.7033097842549307, -1.6799255336909755, -1.651341806134651, -1.6177589892323265, -1.5794236032454694, -1.5366252907913776, -1.489693175204505, -1.4389916515321362, -1.3849156853594442, -1.32788570411645, -1.2683421730233122, -1.2067399532050946, -1.1435425426375159, -1.079216301418622, -1.0142247614088407, -0.9490231166172829, -0.884052984968337, -0.8197375244468412, -0.7564769773271315, -0.6946447055152664, -0.6345837682791868, -0.5766040811333053, -0.5209801817169039, -0.46794961549460223, -0.4177119413365453, -0.3704283448113242, -0.3262218356238087, -0.28517799529596566, -0.24734623212480872, -0.21274149281603333, -0.18134637409701876, -0.15311357312272023 ], [ -1.3055740421725295, -1.358379289277551, -1.4095910333404098, -1.4588073654471887, -1.5056253340677153, -1.549645769153111, -1.5904782797403043, -1.6277463452314862, -1.661092414971247, -1.690182926911436, -1.7147131542054452, -1.7344117886356998, -1.7490451719249585, -1.7584210902319832, -1.7623920534453021, -1.7608579891661498, -1.7537682913562722, -1.7411231753068972, -1.7229743036008032, -1.6994246617866802, -1.6706276772263304, -1.636785589648479, -1.5981470969722176, -1.5550043145698782, -1.5076890999535177, -1.456568807541698, -1.4020415493747496, -1.3445310471184553, -1.2844811681982171, -1.2223502442633891, -1.1586052732804897, -1.093716107343015, -1.028149726777681, -0.9623646973974959, -0.8968059019364332, -0.8318996289879041, -0.7680490933968154, -0.7056304512991346, -0.6449893611700515, -0.5864381296587049, -0.5302534679907662, -0.4766748716458742, -0.4259036231908879, -0.3781024058783093, -0.3333955041802717, -0.29186955706558115, -0.25357482074338455, -0.21852688995040065, -0.18670882076071332, -0.15807359341142058 ], [ -1.3182634618056426, -1.3715539743394987, -1.4232330676319171, -1.4728957811633383, -1.5201361981208714, -1.5645523044786356, -1.6057510206816792, -1.6433533254974035, -1.6769993860713075, -1.7063536044232963, -1.7311094887182674, -1.7509942577649549, -1.7657730894132742, -1.7752529278492775, -1.779285771186254, -1.777771369119316, -1.7706592705896538, -1.7579501731796319, -1.7396965390675974, -1.7160024565060186, -1.6870227406081586, -1.652961282373064, -1.614068669968411, -1.5706391209456685, -1.523006777911638, -1.4715414328740342, -1.4166437566976853, -1.358740119573231, -1.2982770958829584, -1.2357157521746553, -1.1715258200114305, -1.1061798562035041, -1.040147491361994, -0.9738898639219884, -0.9078543309001053, -0.8424695388715612, -0.7781409292124156, -0.7152467408325411, -0.6541345617316877, -0.5951184680733315, -0.5384767764260104, -0.4844504217069099, -0.43324196050351577, -0.3850151871528069, -0.3398953385018752, -0.2979698529020294, -0.2592896399029169, -0.22387080947146826, -0.19169680347318296, -0.16272086768292138 ], [ -1.3289483269814009, -1.3826223590903777, -1.434668589587499, -1.4846797153761757, -1.5322475790034056, -1.576968054727895, -1.6184461057779331, -1.6563009318848159, -1.690171120682443, -1.7197197128065889, -1.7446390886786658, -1.7646555851423211, -1.7795337524080954, -1.78908016616664, -1.793146716210438, -1.7916333013540955, -1.7844898707025783, -1.771717763169035, -1.753370310323605, -1.7295526818539069, -1.700420967795238, -1.6661805068781566, -1.6270834854644192, -1.5834258462184092, -1.5355435595193079, -1.4838083233089976, -1.4286227682734385, -1.3704152546934736, -1.309634354746398, -1.2467431193202607, -1.1822132314071756, -1.1165191488224784, -1.0501323373699523, -0.9835156917188743, -0.9171182353157139, -0.8513701828147482, -0.7866784390185318, -0.7234225974504029, -0.6619514897462633, -0.6025803243807961, -0.5455884401720219, -0.49121768687494755, -0.4396714323062688, -0.39111418314344826, -0.3456717950909491, -0.30343223774593775, -0.2644468704270714, -0.22873217760940545, -0.1962719065455567, -0.16701954520942008 ], [ -1.3375703666667964, -1.391523442091325, -1.4438339041405985, -1.4940928313196098, -1.5418905654601116, -1.5868216166270033, -1.6284897372862484, -1.6665130844704314, -1.7005293832286192, -1.7302010009447724, -1.7552198403224901, -1.775311959085117, -1.790241826799237, -1.7998161337083267, -1.803887073016357, -1.8023550265821855, -1.7951705943112937, -1.7823359194435338, -1.7639052751668376, -1.7399848922277035, -1.7107320221172186, -1.6763532456195664, -1.6371020516396162, -1.5932757258961214, -1.5452116029070702, -1.493282747354041, -1.4378931420755858, -1.3794724693297213, -1.3184705793558031, -1.2553517454864336, -1.1905888080011555, -1.124657309530126, -1.0580297231261322, -0.9911698702090288, -0.9245276195884118, -0.8585339508831672, -0.793596456121959, -0.7300953424075256, -0.6683799865694775, -0.6087660800443857, -0.5515333891464311, -0.49692414276347474, -0.4451420466576515, -0.39635191127157987, -0.35067986851739225, -0.308214142697241, -0.2690063316704825, -0.2330731467997036, -0.20039855418310276, -0.1709362552744771 ], [ -1.3440816012645307, -1.3982070733700285, -1.4506767235479967, -1.5010807475448, -1.5490087378736108, -1.5940545992948318, -1.6358216311148124, -1.6739276948194108, -1.7080103801692674, -1.7377320792471447, -1.762784876231358, -1.7828951609933303, -1.797827877048931, -1.8073903189429945, -1.8114354007660158, -1.8098643260834275, -1.8026285999356924, -1.7897313355217226, -1.7712278214401111, -1.747225329621927, -1.7178821590018687, -1.6834059251748246, -1.6440511213931388, -1.6001159908963527, -1.5519387643600218, -1.4998933288555931, -1.4443844058135058, -1.3858423248023197, -1.3247174872539627, -1.2614746194108137, -1.196586916637746, -1.1305301817879223, -1.0637770585559876, -0.9967914567798395, -0.9300232606045502, -0.8639034024957596, -0.798839376527285, -0.7352112534501467, -0.6733682480874711, -0.6136258769207988, -0.5562637306755841, -0.5015238736129569, -0.44960986841525286, -0.4006864133181224, -0.35487956676675125, -0.312277524597349, -0.27293190576554976, -0.23685949511411647, -0.20404438569978073, -0.17444045884150056 ], [ -1.3484447770320145, -1.4026344119605492, -1.4551566480363678, -1.505601541541762, -1.5535586946078066, -1.5986221729308765, -1.6403955873517304, -1.6784972577256325, -1.7125653721958263, -1.7422630514231439, -1.7672832256863604, -1.7873532331690523, -1.8022390502539203, -1.8117490692630696, -1.8157373457619743, -1.81410624617585, -1.8068084368825839, -1.793848167924848, -1.7752818177559002, -1.7512176796876904, -1.7218149856027378, -1.687282177656537, -1.6478744537568697, -1.6038906271816136, -1.5556693544196072, -1.503584797844138, -1.4480418008420015, -1.3894706622518664, -1.3283216041918515, -1.2650590324130762, -1.2001556910991225, -1.1340868144999359, -1.0673243759660898, -1.0003315309204666, -0.933557344213783, -0.8674318843544568, -0.802361757526186, -0.7387261433888126, -0.6768733827095607, -0.6171181542204051, -0.5597392650795674, -0.5049780662649035, -0.4530374914667523, -0.40408170587903064, -0.35823633998252546, -0.3155892732104089, -0.2761919234788341, -0.24006099110638002, -0.20718059973919545, -0.17750477260102632 ], [ -1.350633711351895, -1.4047782892485654, -1.45724554722256, -1.50762614914915, -1.5555104692332662, -1.6004935035920438, -1.6421799422377275, -1.6801893199332907, -1.7141611591642658, -1.743760014998489, -1.7686803300533405, -1.78865100827255, -1.8034396187940176, -1.8128561458721977, -1.8167562075502675, -1.8150436744469387, -1.807672630461059, -1.794648629182047, -1.7760292130547926, -1.7519236765732655, -1.722492069624277, -1.6879434522064878, -1.6485334267331662, -1.6045609886139538, -1.5563647494352266, -1.5043185994778288, -1.4488268872146297, -1.3903192025501379, -1.3292448576822724, -1.2660671644202672, -1.2012576094813368, -1.1352900296743822, -1.0686348869865423, -1.0017537395057186, -0.9350939979840716, -0.8690840498722644, -0.8041288230754025, -0.7406058507799714, -0.6788618867854032, -0.6192101081709598, -0.5619279291726349, -0.507255437167935, -0.45539444898837744, -0.4065081736992241, -0.3607214567730767, -0.3181215704726441, -0.2787595064414458, -0.24265171912819244, -0.20978226284309587, -0.1801052610172183 ], [ -1.3506335444817035, -1.404623473494528, -1.4569278374228531, -1.5071386546094674, -1.5548478332341202, -1.599652068402064, -1.641157895673512, -1.6789868196822968, -1.7127804313636776, -1.7422054239379887, -1.766958416338144, -1.7867704933369244, -1.8014113742839302, -1.8106931271051456, -1.8144733509951039, -1.8126577599284677, -1.80520210956472, -1.792113422092526, -1.7734504767890178, -1.7493235482428897, -1.7198933889663588, -1.6853694681366327, -1.6460074930875521, -1.6021062545431275, -1.5540038500840976, -1.5020733526271057, -1.4467180014668708, -1.3883660024204953, -1.327465030605115, -1.2644765342173439, -1.1998699402673516, -1.1341168635168277, -1.0676854179064006, -1.0010347256234307, -0.9346097128019719, -0.8688362728618642, -0.8041168689266143, -0.740826635890421, -0.6793100308403565, -0.6198780680055604, -0.5628061615329253, -0.508332586507696, -0.45665755606421987, -0.40794290046240306, -0.3623123229057091, -0.31985219687762145, -0.2806128610655209, -0.24461036066978897, -0.2118285781610405, -0.18222169240264152 ], [ -1.34844089449952, -1.4021668320596536, -1.4542006511822199, -1.5041364674055462, -1.551568480136857, -1.5960958469389601, -1.637327709813834, -1.6748882924385677, -1.7084219822944462, -1.7375983083654507, -1.7621167237244788, -1.7817111029826542, -1.7961538673056836, -1.805259654501766, -1.8088884585002194, -1.806948171253203, -1.799396470533297, -1.7862420090428646, -1.7675448734270374, -1.7434162958805255, -1.7140176157188114, -1.6795585031853828, -1.640294472516615, -1.5965237255145532, -1.5485833802263727, -1.4968451514625463, -1.441710560501266, -1.383605760164326, -1.3229760682994056, -1.2602803074108029, -1.1959850506512335, -1.1305588745890045, -1.0644667171282673, -0.9981644347758813, -0.9320936472646447, -0.8666769495578913, -0.8023135617180228, -0.7393754763003271, -0.6782041511389453, -0.6191077829464788, -0.5623591843814435, -0.50819427447464, -0.4568111798592353, -0.408369932412227, -0.36299273794907183, -0.32076478074624104, -0.2817355200845341, -0.2459204278521323, -0.21330311061707052, -0.18383775552472387 ], [ -1.3440639133053516, -1.397417389069246, -1.4490738966308616, -1.498630383356831, -1.5456840884096619, -1.5898373860188018, -1.630702775835872, -1.6679079397666912, -1.701100779784278, -1.7299543480812285, -1.7541715796693043, -1.773489738283819, -1.7876844892534998, -1.7965735178505573, -1.8000196184805508, -1.7979331887898984, -1.7902740731881877, -1.7770527121781108, -1.758330566988336, -1.7342198030049427, -1.704882230056969, -1.670527512372403, -1.6314106756146693, -1.5878289524696325, -1.5401180214255943, -1.4886477053427827, -1.4338172068472732, -1.3760499662515961, -1.315788234395323, -1.2534874573631563, -1.1896105723856136, -1.1246223143291436, -1.0589836300715598, -0.9931462938277401, -0.9275478102882175, -0.8626066844586138, -0.7987181275831872, -0.7362502577784609, -0.6755408422961846, -0.6168946159981353, -0.5605811979840711, -0.506833615690373, -0.4558474334794667, -0.4077804710565182, -0.362753086238318, -0.32084898688280167, -0.2821165283489678, -0.2465704458351899, -0.21419396543284985, -0.18494123377980481 ], [ -1.3375222427174358, -1.3903962774962506, -1.4415702055927744, -1.4906445288402845, -1.5372202619354711, -1.5809037366154368, -1.62131154755651, -1.6580755599526915, -1.690847893981436, -1.7193057983468905, -1.7431563239539056, -1.7621407096117032, -1.7760383945431901, -1.7846705773795053, -1.7879032481866761, -1.7856496287834571, -1.7778719669930336, -1.7645826423019457, -1.745844553408321, -1.721770772021464, -1.6925234616900797, -1.658312075031917, -1.61939085714927, -1.5760556968808697, -1.5286403805122848, -1.4775123143187476, -1.4230677925544257, -1.3657268959806816, -1.3059281125424027, -1.2441227762107796, -1.1807694222266918, -1.116328156975816, -1.0512551385403053, -0.9859972596967767, -0.9209871189160145, -0.8566383569648194, -0.7933414272564056, -0.7314598574177285, -0.6713270479408716, -0.6132436415767635, -0.5574754846347951, -0.50425218888853, -0.4537662906601022, -0.4061729921464158, -0.36159045941255147, -0.3201006419301527, -0.2817505702594734, -0.2465540815985794, -0.21449391754232705, -0.18552413455262345 ], [ -1.3288468709007337, -1.3811365859162912, -1.431724770709992, -1.4802161884098999, -1.5262163483405375, -1.569336263202995, -1.6091973421870076, -1.6454363406634849, -1.677710282505743, -1.705701268207101, -1.7291210809455988, -1.7477155036904009, -1.7612682633951273, -1.7696045232720152, -1.7725938510229977, -1.7701525995985852, -1.7622456473891979, -1.748887456501703, -1.7301424206694462, -1.7061244880814048, -1.6769960586634733, -1.6429661697504665, -1.6042879982923277, -1.5612557213856175, -1.51420078966831, -1.463487679643268, -1.409509201017267, -1.3526814434142125, -1.2934384531486591, -1.2322267349881981, -1.1694996759093774, -1.105711987739447, -1.0413142633139407, -0.9767477364637156, -0.9124393299251345, -0.8487970673414884, -0.7862059161328386, -0.7250241174279664, -0.6655800477733154, -0.6081696452717009, -0.5530544204750018, -0.5004600600725088, -0.4505756194790217, -0.40355328911129873, -0.3595087086964833, -0.3185217945947562, -0.2806380370148019, -0.245870217285722, -0.2142004901099141, -0.18558277200078616 ], [ -1.3180798905632771, -1.3696831014544362, -1.419585073185802, -1.4673955174989122, -1.5127251369403858, -1.5551903273568932, -1.594418010129834, -1.6300505156111706, -1.6617504347823902, -1.6892053534233626, -1.712132382186118, -1.7302823970131185, -1.7434439073625514, -1.75144647469275, -1.7541636105468668, -1.751515092245558, -1.743468644464856, -1.73004094662555, -1.7112979387828484, -1.6873544122790718, -1.6583728854786122, -1.6245617790966373, -1.5861729196071932, -1.5434984126217528, -1.4968669406290478, -1.4466395507683711, -1.3932050080922231, -1.3369747978224389, -1.2783778662279874, -1.2178551938177056, -1.155854296469896, -1.092823749895235, -1.0292078304905834, -0.9654413612868538, -0.9019448454748361, -0.8391199621062575, -0.777345489251855, -0.7169737094238323, -0.6583273407304422, -0.6016970253330682, -0.5473393946328116, -0.4954757185314055, -0.4462911343831017, -0.39993444015174096, -0.3565184260528027, -0.31612070980195794, -0.27878503267819593, -0.24452296706807997, -0.21331598107112898, -0.18511780215468288 ], [ -1.3052741615365093, -1.3560919516939207, -1.405210504070109, -1.4522451432784549, -1.4968124395237816, -1.5385348489759028, -1.5770454773159737, -1.6119928888486297, -1.6430458793043985, -1.6698981278746416, -1.6922726432596409, -1.7099259196574874, -1.7226517217153887, -1.730284422490803, -1.7327018253580238, -1.729827409423142, -1.721631948201842, -1.7081344628479003, -1.6894024838312236, -1.665551608354166, -1.6367443546386884, -1.6031883281731714, -1.5651337287282945, -1.522870240092126, -1.47672335670537, -1.4270502123931472, -1.374234985917162, -1.3186839658808855, -1.260820363428212, -1.201078965053294, -1.1399007196139417, -1.077727353298795, -1.0149961038829982, -0.9521346612179511, -0.8895563946884324, -0.8276559405322066, -0.7668052126889949, -0.7073498904945934, -0.6496064253514333, -0.5938595967915546, -0.5403606364081022, -0.4893259262680412, -0.4409362669187449, -0.39533669922953024, -0.3526368543025907, -0.31291179674813524, -0.2762033189096865, -0.24252163726941, -0.21184743733969275, -0.18413420989252582 ], [ -1.290492881500091, -1.3404301495290691, -1.388671883290016, -1.434839658094007, -1.4785565586102085, -1.5194517499690958, -1.5571651651272163, -1.5913522319323812, -1.6216885592399488, -1.6478744990087013, -1.6696395006773883, -1.6867461753740525, -1.698993990673421, -1.7062225216750007, -1.7083141910539752, -1.7051964393143593, -1.696843276573942, -1.6832761786122985, -1.6645643023547123, -1.6408240091508244, -1.612217697817286, -1.578951963112265, -1.5412751087550476, -1.4994740569585525, -1.453870708384317, -1.4048178171596455, -1.3526944548510786, -1.2979011448428142, -1.240854754247979, -1.1819832341611685, -1.1217203006749963, -1.060500148621729, -0.9987522875093215, -0.9368965847005455, -0.8753385946852934, -0.8144652455152288, -0.7546409443407709, -0.6962041537761601, -0.6394644798043132, -0.5847003004164247, -0.5321569524621914, -0.4820454825595595, -0.43454195665839057, -0.3897873122287794, -0.347887727281802, -0.30891547172439393, -0.2729101990587623, -0.23988063027771528, -0.20980657705582378, -0.18264124802611964 ], [ -1.2738090697023747, -1.3227750460999483, -1.3700508818488069, -1.4152650111859235, -1.4580476491656382, -1.4980352866642064, -1.5348752944229243, -1.568230560724095, -1.5977840833948789, -1.6232434345780111, -1.6443450162190112, -1.660858025575139, -1.6725880532820494, -1.6793802415977677, -1.6811219373067812, -1.6777447822837415, -1.669226194711876, -1.6555902052060025, -1.6369076243447849, -1.6132955310803667, -1.5849160848505686, -1.5519746776395595, -1.5147174553823615, -1.4734282506573249, -1.4284249802438531, -1.3800555715502787, -1.3286934908820713, -1.2747329538073116, -1.2185839033159889, -1.160666844945051, -1.1014076294899375, -1.0412322733396628, -0.9805619039052559, -0.9198079131628796, -0.8593673961542613, -0.7996189435725676, -0.7409188485426097, -0.6835977776401108, -0.6279579453656327, -0.5742708199862414, -0.5227753771759862, -0.4736769065123213, -0.42714636489297997, -0.3833202605778839, -0.3423010420563382, -0.3041579574808776, -0.268928343147643, -0.23661929355163663, -0.2072096609746173, -0.18065232940428966 ], [ -1.2553049695484009, -1.3032136980274283, -1.349439353758469, -1.3936178056030104, -1.43538698102437, -1.4743912785166142, -1.5102860815719175, -1.5427423000404175, -1.571450861033898, -1.5961270694402665, -1.6165147577673107, -1.6323901464950292, -1.643565339411413, -1.649891383511759, -1.6512608298805482, -1.6476097404207128, -1.6389190951736892, -1.625215566066675, -1.6065716349751398, -1.5831050467118017, -1.554977600638325, -1.522393297719569, -1.4855958726749217, -1.4448657531052378, -1.4005164987810796, -1.3528907843866567, -1.3023559976754782, -1.24929953200044, -1.1941238573710957, -1.137241457453749, -1.0790697212087028, -1.0200258771516808, -0.960522055584615, -0.9009605596685736, -0.8417294200590559, -0.7831983001844391, -0.7257148103498615, -0.6696012789469883, -0.61515201841972, -0.5626311125623119, -0.5122707404966379, -0.4642700415698681, -0.4187945146983588, -0.375975935601866, -0.33591276614036125, -0.29867102176646676, -0.26428555608606263, -0.23276171578506694, -0.2040773147985105, -0.1781848735959679 ], [ -1.2350713768624013, -1.2818421561579072, -1.326938585317285, -1.3700045083202914, -1.410686110422416, -1.4486362419105867, -1.4835188356564042, -1.5150133456794546, -1.5428191304337053, -1.566659702621909, -1.5862867671377023, -1.6014839703008614, -1.612070286908955, -1.6179029767502655, -1.618880049029701, -1.6149421815245315, -1.6060740510359799, -1.5923050426201408, -1.5737093169145357, -1.550405227342854, -1.5225540917759224, -1.4903583360357366, -1.454059039131422, -1.4139329219982777, -1.3702888324760285, -1.3234637890372716, -1.2738186541222194, -1.2217335146512254, -1.1676028522183755, -1.1118305885134743, -1.0548250926246578, -0.9969942360416612, -0.9387405784650535, -0.880456763034019, -0.8225211934655354, -0.7652940580414127, -0.7091137566123058, -0.6542937770599454, -0.6011200572400529, -0.5498488575974337, -0.5007051586814586, -0.45388158696736847, -0.4095378619644027, -0.36780074780183575, -0.32876448353701193, -0.2924916585012754, -0.2590144922302847, -0.22833647301610632, -0.20043430493222752, -0.17526011034289318 ], [ -1.2132069014676574, -1.2587646839125184, -1.3026584702794208, -1.3445405825574421, -1.3840659700828755, -1.4208964389286187, -1.4547049671473427, -1.4851800345319561, -1.5120298922665008, -1.5349866961124663, -1.5538104267151387, -1.5682925222846555, -1.5782591523234581, -1.5835740662043931, -1.5841409571710834, -1.5799052906067599, -1.5708555550261178, -1.5570239049731818, -1.5384861766079627, -1.5153612689580607, -1.487809896301528, -1.4560327296246158, -1.4202679572514398, -1.3807883062675201, -1.3378975769672645, -1.2919267519833852, -1.2432297497730473, -1.1921788985500708, -1.1391602114184871, -1.0845685462826435, -1.0288027350373259, -0.9722607655838109, -0.9153350974318619, -0.858408187139071, -0.8018482937577407, -0.7460056269947613, -0.6912088921629721, -0.637762276459819, -0.5859429109138286, -0.5359988317637385, -0.48814745435127027, -0.4425745620813635, -0.3994338028830709, -0.35884667611810683, -0.32090298423318436, -0.2856617158052658, -0.2531523201193265, -0.22337632814211467, -0.19630927077074606, -0.1719028425620004 ], [ -1.1898171704511498, -1.2340929141031236, -1.2767166202742737, -1.3173495521485574, -1.355655888191085, -1.3913068519047092, -1.423984919332724, -1.4533880345084, -1.4792337599755387, -1.5012632879589876, -1.519245237849441, -1.5329791674399003, -1.5422987288241845, -1.5470744050058325, -1.547215769986217, -1.5426732232753517, -1.5334391592253325, -1.5195485421136068, -1.5010788692559842, -1.4781495163359863, -1.4509204713066772, -1.4195904753523543, -1.384394601187553, -1.345601310124351, -1.303509039577383, -1.258442381745111, -1.2107479218844643, -1.1607898107012835, -1.1089451497727758, -1.0555992715099594, -1.0011409959174578, -0.945957945325419, -0.8904319954134817, -0.8349349363263567, -0.7798244116442807, -0.7254401956058512, -0.6721008605036614, -0.620100876825592, -0.5697081787540322, -0.5211622173263617, -0.4746725131673495, -0.43041771048441896, -0.3885451242109872, -0.34917076301153915, -0.3123798025171098, -0.27822747580295615, -0.2467403418781844, -0.21791788792042183, -0.19173441721056872, -0.16814117222020597 ], [ -1.1650139820835295, -1.207944953716349, -1.249237420508266, -1.2885620085248672, -1.3255925473443062, -1.360010095360051, -1.3915070345979872, -1.4197911668653607, -1.4445897401899783, -1.465653333147901, -1.4827595249090426, -1.4957162807045248, -1.5043649859448633, -1.5085830673559046, -1.5082861461656996, -1.5034296764412616, -1.4940100309683912, -1.4800650073820556, -1.461673738348206, -1.4389560012045586, -1.4120709343035225, -1.3812151790722251, -1.3466204782182691, -1.3085507712797877, -1.2672988385757287, -1.2231825533126475, -1.1765408089360716, -1.1277291946037145, -1.0771154957745017, -1.0250750992677289, -0.971986382716244, -0.9182261671305212, -0.8641653083694889, -0.8101644987862433, -0.7565703443312706, -0.7037117751366193, -0.6518968392855178, -0.6014099203291328, -0.5525094093961982, -0.5054258527095283, -0.46036058523253587, -0.41748485126671603, -0.37693940334048415, -0.3388345618819451, -0.30325071013770244, -0.27023919174052885, -0.23982357236075036, -0.2120012220842053, -0.18674517159231302, -0.16400619289059815 ], [ -1.1389144198387864, -1.1804444466687074, -1.220351041311818, -1.258314571430462, -1.2940188951473515, -1.3271552775343616, -1.357426368300291, -1.3845501741842234, -1.4082639569225612, -1.4283279864835525, -1.4445290796397794, -1.4566838559224737, -1.464641646575022, -1.468286997255207, -1.467541711840529, -1.4623663926392552, -1.4527614414321908, -1.438767495860727, -1.4204652864994363, -1.3979749112461817, -1.3714545351525804, -1.3410985352181077, -1.3071351206970756, -1.2698234698435276, -1.229450433485637, -1.1863268641445863, -1.1407836363907449, -1.093167429597831, -1.0438363480915025, -0.9931554558158711, -0.9414923030308278, -0.8892125212231617, -0.8366755594302414, -0.784230630644508, -0.7322129310382469, -0.6809401876023274, -0.630709581639926, -0.5817950866266396, -0.5344452494862332, -0.4888814345860052, -0.445296539975815, -0.40385418581937205, -0.3646883658193764, -0.3279035439220146, -0.29357517087749835, -0.26175058847791105, -0.23245028360490283, -0.20566944967668765, -0.18137980973031553, -0.15953165322130525 ], [ -1.11163993629686, -1.1517196048946228, -1.1901924164730568, -1.2267488148900627, -1.2610830185447597, -1.2928968241653855, -1.3219034634375646, -1.3478314477341993, -1.3704283337917322, -1.3894643421896211, -1.4047357610105553, -1.4160680691286516, -1.423318717190302, -1.4263795094731697, -1.4251785363451759, -1.4196816148681153, -1.4098932040317873, -1.3958567709616543, -1.377654594984743, -1.3554070074106934, -1.3292710760185207, -1.2994387542584542, -1.2661345258069385, -1.2296125850854818, -1.1901536034221114, -1.1480611384736885, -1.103657751146042, -1.0572808993914007, -1.0092786818149913, -0.9600055059155628, -0.9098177559943976, -0.8590695343166632, -0.8081085460649744, -0.757272194096432, -0.7068839436479115, -0.6572500101089029, -0.6086564150017382, -0.561366446600773, -0.5156185524214677, -0.4716246813597863, -0.42956908380125125, -0.389607568777894, -0.3518672084450163, -0.31644647197183695, -0.2834157635587211, -0.25281833284693084, -0.22467152058151646, -0.19896829809671568, -0.17567905605582812, -0.15475359590014914 ], [ -1.0833154169129284, -1.1219022183412275, -1.1589001995236168, -1.1940101701834611, -1.226936994227657, -1.257393277428518, -1.2851030995846404, -1.3098057282347704, -1.33125924880482, -1.3492440452660797, -1.3635660660454105, -1.3740598120908745, -1.3805909876531781, -1.3830587594469812, -1.3813975763172068, -1.3755785092251864, -1.365610080121162, -1.351538557884569, -1.3334477097649327, -1.3114580073968676, -1.2857252972309163, -1.2564389558507125, -1.2238195608702742, -1.1881161176676824, -1.149602890874675, -1.1085758970923814, -1.0653491215591857, -1.0202505263113502, -0.9736179206449957, -0.9257947663469085, -0.877125990193349, -0.8279538746472751, -0.7786140945843669, -0.7294319633562968, -0.6807189457012651, -0.6327694881124609, -0.5858582094760616, -0.5402374863097932, -0.4961354580015146, -0.4537544682980944, -0.41326995015943646, -0.37482975219194226, -0.33855389641582384, -0.3045347492861722, -0.27283758083801773, -0.24350148069126337, -0.21654059453203445, -0.19194564064977865, -0.16968566318902722, -0.1497099769744895 ], [ -1.054068233698453, -1.0911266545082978, -1.126615709209606, -1.160246817652415, -1.1917357275280098, -1.2208060830267486, -1.2471930296507172, -1.270646794118602, -1.2909361763287515, -1.307851889728538, -1.3212096872402563, -1.3308532121457493, -1.3366565170234606, -1.3385261989123394, -1.3364031052564895, -1.330263572733608, -1.3201201696249063, -1.3060219217488362, -1.2880540119341806, -1.2663369533091626, -1.2410252470787666, -1.2123055456939573, -1.1803943521283187, -1.1455352951243822, -1.1079960285260289, -1.068064809971907, -1.0260468201153676, -0.9822602880221944, -0.9370324913811221, -0.8906957015881696, -0.8435831436218807, -0.796025038942923, -0.7483447964996822, -0.7008554124110142, -0.653856133172312, -0.6076294304637742, -0.5624383280268365, -0.5185241128282944, -0.47610445407473584, -0.43537194479805946, -0.39649307192832905, -0.3596076122151103, -0.32482844324930865, -0.2922417513500075, -0.26190761136583873, -0.23386090762070239, -0.20811256040191944, -0.18465101860646616, -0.1634439764579103, -0.1444402705829091 ], [ -1.0240272987826287, -1.059528858090025, -1.0934818752939952, -1.125608579073893, -1.1556357921162979, -1.1832983783198037, -1.208342717906816, -1.230530151286386, -1.2496403307618182, -1.2654744187407687, -1.27785807204389, -1.286644154244919, -1.2917151216962601, -1.292985033946136, -1.2904011455448092, -1.2839450436394184, -1.2736333041075512, -1.2595176480870864, -1.2416845904080387, -1.2202545813872523, -1.1953806534634617, -1.167246593979233, -1.1360646748119694, -1.1020729782835745, -1.0655323666205514, -1.0267231490010793, -0.9859415057502725, -0.9434957334022052, -0.8997023770480248, -0.8548823175851452, -0.8093568811659284, -0.763444036349801, -0.7174547412634555, -0.6716894985798848, -0.6264351704804257, -0.5819620991343901, -0.5385215708092665, -0.4963436537174686, -0.45563543132833, -0.4165796443440631, -0.3793337460688438, -0.34402936769411796, -0.3107721822676655, -0.2796421489757722, -0.250694112989168, -0.2239587306192926, -0.19944368498769638, -0.17713515388344875, -0.15699948899713112, -0.13898506427149215 ], [ -0.9933221276123011, -1.0272453610514158, -1.0596421955995285, -1.0902458220831854, -1.118794282555272, -1.1450337941053579, -1.168722092443693, -1.1896317380452817, -1.2075533261091074, -1.2222985413301708, -1.2337029995526252, -1.2416288207894233, -1.2459668818392742, -1.246638701749468, -1.2435979195703464, -1.2368313310959478, -1.2263594594256817, -1.212236643026065, -1.1945506343090249, -1.1734217113472538, -1.1490013149803278, -1.121470232988096, -1.0910363619843488, -1.0579320859898573, -1.0224113180731491, -0.9847462578181387, -0.9452239225375646, -0.9041425139817437, -0.8618076847127024, -0.8185287692822256, -0.7746150448672872, -0.7303720841152213, -0.6860982597092875, -0.6420814556926508, -0.5985960350259608, -0.5559001063664266, -0.5142331258310062, -0.4738138617429234, -0.43483874226709185, -0.3974805976252587, -0.361887800449946, -0.3281837999813666, -0.2964670384110915, -0.2668112308882168, -0.23926598466173948, -0.21385772764397315, -0.19059091242328396, -0.1694494584797941, -0.1503983930863102, -0.13338565010175807 ], [ -0.9620819212098034, -0.994412313112409, -1.0252397148202943, -1.0543083877284622, -1.0813676913397146, -1.1061752822220883, -1.1285003247577405, -1.1481266584405831, -1.1648558651641658, -1.178510179858778, -1.188935189034924, -1.196002264282731, -1.1996106815410865, -1.1996893819279366, -1.1961983360205959, -1.189129480564552, -1.1785072045139677, -1.1643883698828588, -1.1468618619082982, -1.1260476722758321, -1.1020955284041567, -1.075183090800354, -1.045513749053119, -1.0133140549157487, -0.9788308379476511, -0.942328055161392, -0.9040834309195402, -0.8643849468326552, -0.8235272435536545, -0.7818079971095973, -0.7395243317629115, -0.6969693293915026, -0.654428692097875, -0.6121776103112999, -0.5704778831725335, -0.5295753316503614, -0.4896975378140741, -0.45105193616990114, -0.41382427516223796, -0.3781774590432438, -0.34425077252203085, -0.31215948310175834, -0.28199480896796997, -0.2538242338531763, -0.22769214459620857, -0.20362076223982006, -0.18161133353856684, -0.16164554672545806, -0.143687133326865, -0.1276836167109654 ], [ -0.9304346764492896, -0.961164542125451, -0.9904160351143203, -1.0179445516941166, -1.043510821479816, -1.066883980544401, -1.0878446485356208, -1.1061879565375339, -1.1217264713218018, -1.1342929617212876, -1.1437429541792294, -1.1499570270894341, -1.1528427973203943, -1.152336557248245, -1.1484045266154088, -1.1410436904573393, -1.1302822020439722, -1.1161793380859932, -1.098825002159642, -1.0783387811952094, -1.054868568732987, -1.0285887772556261, -0.999698170041825, -0.968417350450135, -0.9349859531485538, -0.8996595873943585, -0.862706586907126, -0.8244046240657272, -0.7850372480324644, -0.7448904069357083, -0.7042490134349766, -0.6633936108936572, -0.6225971940731719, -0.5821222338476018, -0.5422179500564008, -0.5031178704234519, -0.46503770664930705, -0.428173571517198, -0.39270055333467685, -0.3587716564540747, -0.32651710916236937, -0.29604403307973626, -0.26743646151539213, -0.24075568813895193, -0.21604092195236518, -0.19331021998352654, -0.17256166543332074, -0.15377475623206738, -0.13691196711140086, -0.121920447360788 ], [ -0.898506332742897, -0.9276346532279243, -0.955310367849944, -0.9813000290554617, -1.00537574497608, -1.0273181261947073, -1.046919228930875, -1.0639854434002707, -1.0783402752059599, -1.0898269678710404, -1.0983109160600841, -1.1036818216628816, -1.105855548698961, -1.1047756378821605, -1.1004144475658566, -1.0927738945462853, -1.081885775681108, -1.0678116593083624, -1.0506423438337145, -1.0304968893863873, -1.0075212369145863, -0.9818864372878661, -0.9537865206917022, -0.9234360436456672, -0.8910673571770579, -0.8569276448856592, -0.8212757837201636, -0.7843790831610923, -0.74650996011176, -0.7079426071156957, -0.6689497105590302, -0.6297992733275732, -0.5907515930500966, -0.5520564426811171, -0.5139504948923614, -0.4766550257073826, -0.44037392619873966, -0.4052920440526374, -0.37157386957665406, -0.33936257346611043, -0.30877939653095404, -0.2799233847837317, -0.2528714569504637, -0.2276787857208314, -0.2043794690108316, -0.1829874632542236, -0.16349774732783018, -0.1458876831835243, -0.13011853761464343, -0.11613712881112459 ], [ -0.8664199628599174, -0.8939521749414747, -0.9200586351279115, -0.9445170316353155, -0.9671108167008148, -0.9876320269259511, -1.005884092713277, -1.0216845875642058, -1.034867867309226, -1.0452875497526597, -1.0528187867624363, -1.057360283519441, -1.0588360234276695, -1.0571966620104547, -1.0524205588841087, -1.0445144234840555, -1.0335135574708079, -1.0194816844931693, -1.0025103660468475, -0.982718010340244, -0.9602484891623195, -0.9352693855379413, -0.9079699022589544, -0.8785584680119367, -0.8472600836227763, -0.81431345576299, -0.779967969200246, -0.744480551243227, -0.7081124833789506, -0.6711262152130564, -0.6337822347180778, -0.5963360465219808, -0.5590353066101366, -0.5221171574770264, -0.48580580258145634, -0.45031035308196, -0.4158229734225928, -0.38251734557766387, -0.35054746482400595, -0.32004677296704415, -0.2911276281701558, -0.2638811040827518, -0.2383771049720298, -0.21466477815892138, -0.1927732003406194, -0.17271231042757795, -0.15447405838456352, -0.13803373727158108, -0.12335146423534149, -0.11037377558720485 ], [ -0.8342950148477238, -0.8602427595894638, -0.8847926288538936, -0.9077333861391284, -0.9288597522611548, -0.9479750996414739, -0.9648941286414999, -0.9794454787247764, -0.9914742267255692, -1.0008442250654774, -1.0074402344122226, -1.0111698080104046, -1.011964888696466, -1.0097830843721667, -1.004608593357047, -0.9964527574476023, -0.985354227533005, -0.9713787340881146, -0.9546184626031406, -0.9351910418251604, -0.9132381603849422, -0.8889238347704819, -0.8624323585011873, -0.8339659685816834, -0.8037422707186219, -0.7719914692367353, -0.7389534510284075, -0.704874775139752, -0.6700056206934935, -0.6345967457645095, -0.5988965085800694, -0.5631480000667917, -0.527586333392188, -0.4924361318580951, -0.45790925142614536, -0.4242027684386705, -0.39149725690214277, -0.35995537319154064, -0.3297207593827632, -0.30091726979343747, -0.2736485188696681, -0.24799774244545908, -0.2240279587547948, -0.20178241050746404, -0.18128526494114333, -0.1625425451040835, -0.14554326275142637, -0.13026072117696375, -0.11665395505133258, -0.1046692738763092 ], [ -0.8022466111966486, -0.8266274445263956, -0.8496392342075298, -0.871081720265854, -0.8907607773884595, -0.908490983939328, -0.92409816628087, -0.9374218731892541, -0.9483177348359915, -0.9566596615163105, -0.9623418390545477, -0.9652804805974824, -0.9654152982787172, -0.9627106629323204, -0.9571564255558884, -0.9487683804509977, -0.9375883567591519, -0.9236839323025852, -0.9071477710567074, -0.8880965930412517, -0.8666697927342383, -0.8430277291031489, -0.8173497168358667, -0.7898317541784522, -0.7606840278041143, -0.7301282392272521, -0.6983948003435231, -0.6657199476557824, -0.6323428256008781, -0.5985025891195651, -0.5644355742373393, -0.5303725830037274, -0.49653632575431733, -0.4631390594203733, -0.4303804556427232, -0.39844572689247093, -0.3675040328157553, -0.33770718276372347, -0.3091886441044455, -0.2820628595993274, -0.2564248710138113, -0.23235024035948648, -0.20989525485603966, -0.18909739696177646, -0.16997605673575056, -0.15253346042579108, -0.13675578656555065, -0.12261443902838254, -0.11006744542305158, -0.09906094890270156 ], [ -0.770384910506772, -0.7932219797347065, -0.8147197233611831, -0.8346887229442053, -0.8529458552973628, -0.8693167374131405, -0.8836381402806898, -0.895760328380152, -0.9055492814996348, -0.9128887563663233, -0.9176821474227861, -0.9198541088985519, -0.9193519040831182, -0.9161464523295311, -0.9102330497118102, -0.901631745305204, -0.8903873616153368, -0.8765691545943406, -0.8602701157800458, -0.8416059262025113, -0.820713578642705, -0.7977496914268426, -0.772888543031087, -0.7463198622033533, -0.7182464129482934, -0.6888814174571839, -0.6584458628103986, -0.6271657389789129, -0.5952692562739464, -0.5629840899416714, -0.530534698103135, -0.4981397567562321, -0.4660097521702199, -0.43434476681981943, -0.4033324901499038, -0.3731464800722637, -0.34394469532174365, -0.31586831279460426, -0.2890408379116445, -0.2635675100434052, -0.23953499924679483, -0.21701138512223822, -0.19604640362289577, -0.17667194322981916, -0.15890276812641324, -0.14273744291852597, -0.1281594310878419, -0.11513833774944915, -0.10363126640287923, -0.09358425919372715 ], [ -0.7388145359881465, -0.7601362263609867, -0.7801491242611363, -0.7986744837464915, -0.8155399973034693, -0.8305821182314763, -0.8436483458606231, -0.854599432360519, -0.863311469933218, -0.8696778181578608, -0.87361083317656, -0.8750433632615374, -0.8739299790375382, -0.8702479111797318, -0.8639976736701166, -0.8552033565570265, -0.8439125784860488, -0.8301960959044811, -0.8141470726228888, -0.7958800201777989, -0.7755294260094361, -0.7532480926828077, -0.7292052170829808, -0.703584243564443, -0.676580529305938, -0.6483988635143546, -0.6192508845570592, -0.589352440531106, -0.5589209391782868, -0.5281727324328017, -0.4973205792778844, -0.46657122804873086, -0.4361231559358336, -0.406164499319855, -0.37687120382841394, -0.34840541778147993, -0.320914147128957, -0.29452818422917637, -0.2693613170176879, -0.24550981941456973, -0.22305221834961536, -0.20204932766988015, -0.1825445345401437, -0.16456431984292097, -0.14811899060090294, -0.1332035996308586, -0.11979902552347454, -0.10787318463745943, -0.09738234608835594, -0.08827252067523272 ], [ -0.7076340741726207, -0.7274736297519803, -0.7460356682135129, -0.7631519154030686, -0.7786606608013296, -0.7924089592726595, -0.8042547899542318, -0.8140691329951115, -0.8217379250524525, -0.8271638555472836, -0.8302679676788784, -0.8309910310717146, -0.8292946566351316, -0.8251621286806499, -0.8185989344702681, -0.8096329770451127, -0.7983144632742124, -0.7847154654208801, -0.7689291609926473, -0.751068762058728, -0.7312661514252077, -0.7096702488963734, -0.6864451361741092, -0.6617679736236675, -0.6358267460488923, -0.6088178776803125, -0.5809437587165672, -0.5524102269305258, -0.5234240480404537, -0.4941904377645546, -0.46491066676189763, -0.435779787075754, -0.4069845153212698, -0.37870130380137557, -0.3510946261121298, -0.3243154987417637, -0.29850025481488374, -0.27376958062554707, -0.25022782008047045, -0.2279625467711403, -0.20704439823698206, -0.18752716218470195, -0.16944810008996303, -0.15282848980854058, -0.1376743656277596, -0.12397743163917818, -0.11171612243400986, -0.10085678391873876, -0.09135494650642062, -0.0831566630296775 ], [ -0.6769356462507238, -0.6953307695269465, -0.7124803189340593, -0.7282262621979139, -0.7424172375027982, -0.7549106368323236, -0.7655746411410442, -0.7742901699891694, -0.7809527086231768, -0.7854739766926814, -0.7877834048568703, -0.7878293884264904, -0.7855802908597984, -0.7810251743100608, -0.7741742394134065, -0.7650589619953901, -0.753731920232535, -0.740266311889353, -0.7247551674113596, -0.707310270736366, -0.6880608055367196, -0.6671517500764851, -0.6447420488223802, -0.6210025932624572, -0.5961140479565231, -0.5702645605830791, -0.5436473965981963, -0.5164585400464492, -0.48889430205280304, -0.46114897759290785, -0.433412589328135, -0.40586875466448036, -0.3786927088355302, -0.35204951282094255, -0.3260924704095975, -0.3009617738270317, -0.276783392202895, -0.25366821189049665, -0.2317114324001785, -0.21099221659824496, -0.19157358897140497, -0.17350257126889213, -0.15681054080137458, -0.14151379317177326, -0.12761428829439403, -0.11510055626298343, -0.10394873797445514, -0.0941237344040744, -0.08558043804359972, -0.0782650202248879 ], [ -0.6468045534858422, -0.6637969882030283, -0.6795763846419867, -0.6939946958879181, -0.7069106336392773, -0.7181916356664217, -0.7277157801871101, -0.7353736116798265, -0.7410698431499042, -0.7447249011741319, -0.7462762821709524, -0.7456796912466388, -0.7429099386010023, -0.737961572765654, -0.7308492347995306, -0.7216077228689889, -0.7102917622665788, -0.696975481736757, -0.681751602833511, -0.6647303547875413, -0.6460381328636959, -0.6258159233040038, -0.604217522549065, -0.5814075823966599, -0.5575595159944904, -0.5328533019983062, -0.5074732258037361, -0.48160559745122045, -0.4554364856037885, -0.42914950592712847, -0.4029237003039639, -0.37693154065493617, -0.3513370878005139, -0.32629433188304996, -0.3019457364883322, -0.278421003884065, -0.2558360738558055, -0.23429236359782357, -0.21387625113267617, -0.1946587999089589, -0.17669571767160636, -0.16002753851148765, -0.14468001326386393, -0.13066469020610316, -0.11797966535331483, -0.1066104795984878, -0.09653113850542883, -0.08770522973546213, -0.08008711285374248, -0.07362315658490926 ], [ -0.6173189972149109, -0.6329540988897058, -0.6474092137196125, -0.6605459996721371, -0.6722329426575377, -0.6823472109018569, -0.6907764517278272, -0.6974204971148111, -0.7021929450366845, -0.7050225849812899, -0.7058546382269018, -0.7046517863580924, -0.7013949650918084, -0.6960839046804514, -0.6887374028690154, -0.6793933214987972, -0.6681083032480696, -0.6549572105479636, -0.6400322942713116, -0.6234421052234007, -0.6053101666288547, -0.5857734305776287, -0.5649805456451933, -0.5430899665319076, -0.5202679394862519, -0.49668639941790504, -0.4725208159238865, -0.4479480259212123, -0.4231440902035625, -0.39828221004124365, -0.37353073796937963, -0.3490513142246609, -0.3249971569803932, -0.301511530691419, -0.27872641260516273, -0.2567613729403139, -0.2357226795027284, -0.2157026327212701, -0.19677913236355943, -0.1790154726454068, -0.16246035818063786, -0.14714812932069332, -0.1330991819817633, -0.12032056411179126, -0.10880672855404105, -0.09854042024462362, -0.08949367444824685, -0.0816289020830594, -0.07490003809063328, -0.06925372923616158 ], [ -0.5885498730333305, -0.6028761716014605, -0.6160559734368116, -0.6279603396587929, -0.63846720980497, -0.6474631461582895, -0.6548450163844672, -0.6605215826584123, -0.6644149662100662, -0.666461957709585, -0.6666151461258318, -0.6648438415958539, -0.6611347713816206, -0.6554925320890567, -0.6479397858917968, -0.6385171934308463, -0.6272830812326883, -0.6143128467746088, -0.5996981095948245, -0.5835456219631514, -0.5659759574655845, -0.547122000290526, -0.5271272619239427, -0.5061440552680162, -0.48433155881305145, -0.46185380535506215, -0.4388776308225639, -0.41557061903887266, -0.392099077706255, -0.36862607958325666, -0.3453096007846641, -0.32230078543199503, -0.2997423626045358, -0.27776723778383455, -0.2564972768549901, -0.23604229634012086, -0.21649926900956062, -0.1979517494611845, -0.18046951978988313, -0.16410845119329165, -0.14891057337150482, -0.13490433996125706, -0.12210507506795887, -0.11051558327600153, -0.10012690336665897, -0.09091918437524948, -0.08286266158044675, -0.07591870952921975, -0.07004094923726312, -0.0651763872311315 ], [ -0.5605606378945889, -0.5736293968178517, -0.5855855102664834, -0.5963091222520487, -0.6056872869216539, -0.6136156060943201, -0.6199998014246003, -0.6247571911338942, -0.6278180421151216, -0.6291267697815736, -0.6286429602788092, -0.6263421925724336, -0.6222166414080448, -0.6162754461382624, -0.6085448348348235, -0.599067997846758, -0.5879047099134795, -0.5751307049713603, -0.5608368127775614, -0.5451278712890917, -0.5281214332556865, -0.5099462895972909, -0.490740835737069, -0.4706513100596567, -0.44982993598957144, -0.4284330007832019, -0.4066189049670252, -0.3845462164235859, -0.3623717624352689, -0.34024879157518156, -0.31832523523463674, -0.2967420958657059, -0.2756319857779132, -0.25511783665522514, -0.2353117959572067, -0.2163143221457839, -0.19821348634844377, -0.18108448373997554, -0.1649893537042022, -0.14997690382292472, -0.13608282901998014, -0.12333001384043663, -0.111729002930951, -0.10127862235510465, -0.0919667324591954, -0.08377109161636687, -0.07666030932164059, -0.07059486677473448, -0.0655281832460416, -0.06140770713677812 ], [ -0.5334072480431711, -0.5452720240592738, -0.5560582894068372, -0.565654934920875, -0.573957774748015, -0.5808710805341629, -0.5863090469719145, -0.5901971603605116, -0.5924734427998364, -0.5930895462714313, -0.5920116731336853, -0.5892213024359012, -0.5847157048795433, -0.5785082331505333, -0.570628378624287, -0.5611215900039163, -0.5500488541796319, -0.5374860443762866, -0.5235230453652328, -0.5082626700364529, -0.49181938584168694, -0.47431787342198045, -0.4558914430274874, -0.4366803370421176, -0.4168299489756827, -0.3964889906353783, -0.3758076398102623, -0.3549357006910199, -0.33402080841689696, -0.3132067076263251, -0.2926316327394696, -0.2724268149878954, -0.25271513801093226, -0.23360996025292835, -0.21521411852126276, -0.1976191230069687, -0.18090454993477195, -0.16513763390178904, -0.15037305798375922, -0.13665293592642713, -0.12400697727930965, -0.11245282323950223, -0.10199653831059208, -0.09263324068820211, -0.08434785258613187, -0.07711595052777309, -0.07090469494445073, -0.06567381823013041, -0.061376650673282795, -0.057961164383585895 ], [ -0.5071381649528033, -0.5178543724550771, -0.5275264102896609, -0.5360515669304546, -0.5433340491299902, -0.5492864163597793, -0.5538309437564213, -0.5569008868865069, -0.5584416227054069, -0.5584116427737115, -0.5567833770875185, -0.5535438297335068, -0.5486950109391153, -0.542254153877755, -0.534253708721425, -0.5247411108089239, -0.5137783243093186, -0.5014411672943722, -0.4878184285750371, -0.47301079089235554, -0.4571295789738242, -0.4402953544722962, -0.4226363828073862, -0.40428699935477197, -0.38538590421880703, -0.3660744159387613, -0.3464947148980148, -0.326788106927622, -0.3070933366389282, -0.28754497842100957, -0.26827193085115275, -0.2493960375589398, -0.23103085443774263, -0.2132805796024418, -0.19623915874649756, -0.1799895746561581, -0.1646033256963777, -0.1501400941907559, -0.136647601870152, -0.12416164604719426, -0.11270630696206752, -0.1022943139023118, -0.09292755527625163, -0.08459771585256726, -0.07728702288947364, -0.07096908187419315, -0.06560978207140022, -0.061168252020267655, -0.05759784549462421, -0.05484713921103135 ], [ -0.4817944257690914, -0.4914189095675311, -0.5000336940999084, -0.5075441058223947, -0.5138623666693101, -0.5189089324794333, -0.5226137574830547, -0.524917459768534, -0.5257723637925282, -0.5251433977348959, -0.5230088258022121, -0.5193607984098321, -0.5142057064631174, -0.5075643296400608, -0.49947177256429215, -0.4899771869525027, -0.47914328211992596, -0.46704563052312187, -0.45377177920127276, -0.43942018193841414, -0.42409897060742097, -0.40792458737939336, -0.3910203022076947, -0.373514642156948, -0.3555397606926178, -0.33722977594243625, -0.3187191071718088, -0.3001408382846053, -0.28162513609010376, -0.2632977494053934, -0.2452786128447873, -0.22768057645259926, -0.21060827924261066, -0.19415718130560533, -0.17841276552950502, -0.1634499162421359, -0.14933247833104135, -0.13611299671175925, -0.1238326324931277, -0.11252124890518511, -0.10219765708125106, -0.09287000917858446, -0.08453632412619672, -0.0771851295353464, -0.07079620201543346, -0.06534138730981065, -0.06078548129378347, -0.057087152940844765, -0.05419989083246324, -0.05207295562241743 ], [ -0.45740977416293205, -0.46600039410719235, -0.4736158386687866, -0.480169104731423, -0.4855800446328312, -0.48977661241541093, -0.49269603409457396, -0.49428587841287197, -0.4945050057667034, -0.493324374768634, -0.490727688214322, -0.4867118630144692, -0.4812873118702303, -0.4744780280422652, -0.4663214684047567, -0.4568682339925568, -0.4461815513419073, -0.4343365619891003, -0.4214194314229106, -0.40752629248421524, -0.3927620415747542, -0.377239008989981, -0.36107552715379093, -0.3443944224447551, -0.32732145761928266, -0.3099837525287335, -0.2925082108847398, -0.2750199802570343, -0.25764097131597957, -0.24048846059855072, -0.22367379883758076, -0.20730124421803248, -0.19146693688946187, -0.17625802775713872, -0.16175197108638406, -0.14801598687868323, -0.13510669540579845, -0.12306992280795037, -0.11194067335600044, -0.10174326091936337, -0.09249158943450952, -0.08418956978545511, -0.07683165852690643, -0.07040350232933656, -0.06488267091634226, -0.06023946059910723, -0.05643775027914677, -0.05343589196683185, -0.05118761841771646, -0.04964295138204189 ], [ -0.43401084699377857, -0.44162607763814266, -0.4483006355354343, -0.45395481502940016, -0.45851570930840513, -0.4619183683978794, -0.4641068795202209, -0.4650353477814674, -0.4646687564263917, -0.46298368771066933, -0.4599688877405591, -0.45562566138188415, -0.4499680864818201, -0.4430230401072129, -0.434830033199304, -0.4254408538860411, -0.4149190235830884, -0.4033390738539886, -0.3907856556898463, -0.37735249631385487, -0.36314122172693164, -0.34826006590759634, -0.33282248979389495, -0.31694573485280153, -0.30074933714415125, -0.28435362828873184, -0.2678782496481236, -0.2514407053282161, -0.23515497835673438, -0.21913023260028353, -0.20346962073476788, -0.18826921593274776, -0.17361708195934877, -0.15959249315894775, -0.14626531245559482, -0.13369553207006635, -0.12193297826280991, -0.11101717812810741, -0.10097738336706874, -0.09183274312391787, -0.08359261543937602, -0.07625700470344765, -0.06981711071208463, -0.0642559735699888, -0.059549197744582005, -0.05566573806144137, -0.05256873032540921, -0.050216349530289306, -0.048562679250927165, -0.047558576754782145 ], [ -0.4116174117632347, -0.41831595992874393, -0.4241082435052389, -0.42892147829619354, -0.4326896064794319, -0.43535437031298396, -0.43686630693961015, -0.4371856436813189, -0.4362830745515699, -0.43414040054230774, -0.43075101853374886, -0.4261202463808583, -0.42026547479257953, -0.41321613996729073, -0.4050135144999798, -0.39571031774548504, -0.3853701505149205, -0.37406676260447436, -0.36188316511344415, -0.34891060271163016, -0.3352474038821047, -0.32099772961981127, -0.30627024304744516, -0.2911767238685848, -0.27583065248057875, -0.2603457888981296, -0.24483477139141602, -0.22940775893433396, -0.21417114021926426, -0.1992263301686128, -0.1846686726174095, -0.17058646522274723, -0.1570601197506506, -0.144161467780493, -0.13195321863592768, -0.12048857308439609, -0.10981099312747111, -0.0999541251098045, -0.09094187047678215, -0.08278859587300502, -0.0754994719483294, -0.06907092826697647, -0.0634912101280437, -0.0587410219204384, -0.054794240857515275, -0.05161868456116081, -0.04917691597557183, -0.047427069462156024, -0.046323682625449725, -0.04581851940583037 ] ], "zauto": true, "zmax": 1.8167562075502675, "zmin": -1.8167562075502675 }, { "autocolorscale": false, "autocontour": true, "colorbar": { "tickfont": { "size": 8 }, "ticksuffix": "", "x": 1, "y": 0.5 }, "colorscale": [ [ 0.0, "rgb(255,247,251)" ], [ 0.14285714285714285, "rgb(236,231,242)" ], [ 0.2857142857142857, "rgb(208,209,230)" ], [ 0.42857142857142855, "rgb(166,189,219)" ], [ 0.5714285714285714, "rgb(116,169,207)" ], [ 0.7142857142857143, "rgb(54,144,192)" ], [ 0.8571428571428571, "rgb(5,112,176)" ], [ 1.0, "rgb(3,78,123)" ] ], "contours": { "coloring": "heatmap" }, "hoverinfo": "x+y+z", "ncontours": 25, "type": "contour", "x": [ 0.0, 0.02040816326530612, 0.04081632653061224, 0.061224489795918366, 0.08163265306122448, 0.1020408163265306, 0.12244897959183673, 0.14285714285714285, 0.16326530612244897, 0.18367346938775508, 0.2040816326530612, 0.22448979591836732, 0.24489795918367346, 0.26530612244897955, 0.2857142857142857, 0.3061224489795918, 0.32653061224489793, 0.3469387755102041, 0.36734693877551017, 0.3877551020408163, 0.4081632653061224, 0.42857142857142855, 0.44897959183673464, 0.4693877551020408, 0.4897959183673469, 0.5102040816326531, 0.5306122448979591, 0.5510204081632653, 0.5714285714285714, 0.5918367346938775, 0.6122448979591836, 0.6326530612244897, 0.6530612244897959, 0.673469387755102, 0.6938775510204082, 0.7142857142857142, 0.7346938775510203, 0.7551020408163265, 0.7755102040816326, 0.7959183673469387, 0.8163265306122448, 0.836734693877551, 0.8571428571428571, 0.8775510204081632, 0.8979591836734693, 0.9183673469387754, 0.9387755102040816, 0.9591836734693877, 0.9795918367346939, 1.0 ], "xaxis": "x2", "y": [ 0.0, 0.02040816326530612, 0.04081632653061224, 0.061224489795918366, 0.08163265306122448, 0.1020408163265306, 0.12244897959183673, 0.14285714285714285, 0.16326530612244897, 0.18367346938775508, 0.2040816326530612, 0.22448979591836732, 0.24489795918367346, 0.26530612244897955, 0.2857142857142857, 0.3061224489795918, 0.32653061224489793, 0.3469387755102041, 0.36734693877551017, 0.3877551020408163, 0.4081632653061224, 0.42857142857142855, 0.44897959183673464, 0.4693877551020408, 0.4897959183673469, 0.5102040816326531, 0.5306122448979591, 0.5510204081632653, 0.5714285714285714, 0.5918367346938775, 0.6122448979591836, 0.6326530612244897, 0.6530612244897959, 0.673469387755102, 0.6938775510204082, 0.7142857142857142, 0.7346938775510203, 0.7551020408163265, 0.7755102040816326, 0.7959183673469387, 0.8163265306122448, 0.836734693877551, 0.8571428571428571, 0.8775510204081632, 0.8979591836734693, 0.9183673469387754, 0.9387755102040816, 0.9591836734693877, 0.9795918367346939, 1.0 ], "yaxis": "y2", "z": [ [ 0.5087149552629503, 0.4949559900887309, 0.4809581289596793, 0.46685060620531055, 0.45277867856816845, 0.43890241397723323, 0.42539460654038713, 0.41243759079803843, 0.40021873474457725, 0.3889244539697436, 0.37873273629416915, 0.36980441486290455, 0.3622737651170878, 0.35623936493330965, 0.35175643178981364, 0.3488318976216994, 0.3474232058422186, 0.3474412343896929, 0.3487570179682024, 0.35121129348182656, 0.3546255224398524, 0.3588130252189575, 0.36358912859815695, 0.3687796350302401, 0.37422732567878647, 0.37979651801793307, 0.385375883630343, 0.3908798075314497, 0.3962485707638476, 0.4014475977925921, 0.4064659560852224, 0.411314244240292, 0.41602196629428545, 0.4206344671665738, 0.42520949801660735, 0.42981348884174214, 0.4345176255363108, 0.43939385498057726, 0.44451096838760473, 0.44993093326107886, 0.4557056513876449, 0.46187430948254704, 0.4684614586538935, 0.47547591084232943, 0.4829104806594857, 0.490742537969155, 0.4989352791185243, 0.5074395804629199, 0.5161962712736172, 0.5251386552407533 ], [ 0.5063141495166917, 0.4923340622172532, 0.4781035622335663, 0.46375273357343505, 0.44942816054312645, 0.43529184376230584, 0.4215192493094379, 0.408296246689721, 0.3958146875031498, 0.3842664294319874, 0.37383575168489663, 0.3646903621627005, 0.3569715569095846, 0.35078449793325683, 0.346189902046254, 0.34319852282984364, 0.3417695412442274, 0.3418133632876766, 0.34319851936243234, 0.34576163117817493, 0.34931898852344345, 0.35367824922170216, 0.3586490692776096, 0.3640519218160046, 0.3697248089214606, 0.37552790729223184, 0.38134638584025665, 0.38709170972130597, 0.39270174002395886, 0.3981398904582113, 0.40339354110410386, 0.4084718527135427, 0.41340308248312757, 0.4182314770974834, 0.4230138111709398, 0.4278156468551253, 0.4327074096453938, 0.4377604012660094, 0.4430428967513766, 0.44861649266696935, 0.45453288040730033, 0.46083120795077576, 0.4675361636237583, 0.47465686839009813, 0.4821866046401916, 0.4901033475876191, 0.4983710089688906, 0.5069412591472879, 0.5157557674050703, 0.5247486921580445 ], [ 0.5043179471764432, 0.49015476623534354, 0.4757307764051871, 0.4611764854872249, 0.4466392760681667, 0.43228244151423917, 0.4182833682618274, 0.4048306067309471, 0.3921195595748531, 0.38034655802879824, 0.3697012307903512, 0.3603573250695846, 0.35246251656650307, 0.34612818659593353, 0.34142052059653444, 0.3383544173065849, 0.3368914493511772, 0.33694247320925874, 0.338374618448299, 0.34102158100399704, 0.34469566637239185, 0.3491999840749308, 0.354339509763608, 0.3599302229738343, 0.36580601336792723, 0.3718234121981836, 0.3778644154791245, 0.38383774313979646, 0.38967886848670036, 0.3953490977026205, 0.40083391149061975, 0.40614071944633645, 0.41129613169826995, 0.4163428249611159, 0.4213360709781352, 0.4263400018794896, 0.4314237053114738, 0.4366572671321534, 0.44210790484586326, 0.4478363540862671, 0.45389367712031503, 0.46031865199210326, 0.4671358719295324, 0.4743546390100093, 0.4819686793255625, 0.48995664687570684, 0.4982833285934251, 0.5069014203782747, 0.5157537181050383, 0.5247755593117917 ], [ 0.5027233940424611, 0.4884153451574063, 0.4738373595365738, 0.4591199713349428, 0.44441085887141885, 0.4298739897688567, 0.4156879305332672, 0.4020430536969408, 0.38913735321467546, 0.37717061025155124, 0.36633677566015727, 0.35681468756986945, 0.34875762983172415, 0.34228270693684776, 0.33746143119065763, 0.3343130990160226, 0.332802310508675, 0.33284133078052097, 0.3342970718617121, 0.3370015997595547, 0.34076453668279566, 0.3453856624315495, 0.35066634721288475, 0.3564189729182416, 0.36247401983959443, 0.3686848852136053, 0.37493072260076066, 0.38111767157723503, 0.38717883410258475, 0.3930732939642118, 0.3987844027941845, 0.404317490376515, 0.409697107858253, 0.4149638829667231, 0.4201710556291338, 0.42538076765357563, 0.43066019719943405, 0.4360776524012981, 0.4416987626121419, 0.44758292382188986, 0.45378016091483087, 0.46032855925228816, 0.46725239009858904, 0.4745610105923636, 0.4822485645341874, 0.4902944526797224, 0.49866448850202894, 0.5073126142745016, 0.516183026992397, 0.525212555141308 ], [ 0.501521127272271, 0.48710590198629394, 0.4724129747434456, 0.45757254098013694, 0.4427321063499501, 0.42805572767704747, 0.41372244018173926, 0.39992359900363345, 0.38685883314080455, 0.37473033146511053, 0.36373529419635425, 0.3540566286694427, 0.3458523590386674, 0.33924470908842863, 0.33431027397042545, 0.3310729216370581, 0.32950087413473644, 0.3295087643984723, 0.33096450861729426, 0.3336999019300447, 0.3375232568844638, 0.3422323104681076, 0.3476259571820563, 0.3535139144693923, 0.35972397609043266, 0.36610692179916166, 0.37253938754568783, 0.37892508526333707, 0.38519474697277994, 0.39130510432439986, 0.3972371377603461, 0.40299376025095, 0.40859704882210474, 0.414085105606465, 0.419508617843374, 0.42492719001086443, 0.430405536763378, 0.43600964730596703, 0.4418030542891108, 0.4478433570429641, 0.45417915433991235, 0.46084753186478195, 0.4678722228137052, 0.47526251838890987, 0.48301295331324234, 0.4911037368274874, 0.49950184943868997, 0.5081626863015615, 0.5170321034988921, 0.5260487147161299 ], [ 0.5006955394925949, 0.4862095723182714, 0.4714395376385535, 0.4565149616896521, 0.44158274860239244, 0.42680650250819735, 0.4123650602703309, 0.3984499616035766, 0.3852615475436535, 0.3730033910126183, 0.3618748662674942, 0.35206189993523396, 0.3437263342938514, 0.3369948333629424, 0.3319487461708513, 0.3286166057872596, 0.32697078869673973, 0.32692921942196856, 0.32836203186677215, 0.33110212241965403, 0.3349578920902219, 0.3397263481328264, 0.34520505976112675, 0.35120202473182116, 0.3575430750937018, 0.36407688369691615, 0.3706778825328286, 0.3772474951102942, 0.3837140718282731, 0.39003185201307367, 0.3961791967273293, 0.40215626465346027, 0.4079822494235574, 0.4136922634414083, 0.4193339392506916, 0.4249638215366571, 0.4306436364572231, 0.43643654494269574, 0.44240350709208986, 0.44859989992629007, 0.4550725352585413, 0.46185721461286483, 0.46897693273520996, 0.4764408020419139, 0.48424372186653375, 0.49236676501755855, 0.5007782068413325, 0.5094350845749596, 0.5182851510020233, 0.5272690773934224 ], [ 0.5002251170707026, 0.48570289887971296, 0.47089162775669396, 0.45591986580847915, 0.4409335299933339, 0.42609528053741874, 0.4115831458784646, 0.3975881130577661, 0.3843103724318577, 0.3719539110321803, 0.3607192415679497, 0.350794278364305, 0.3423437510293233, 0.33549804786580717, 0.33034288186751887, 0.3269114692004259, 0.32518079495922847, 0.3250729287904271, 0.3264613802279597, 0.3291814791263242, 0.33304308588379383, 0.33784377173360886, 0.3433809149451684, 0.3494617226099046, 0.3559107733437371, 0.36257512663705205, 0.36932730781663264, 0.3760665770298007, 0.3827188809528637, 0.3892358210752496, 0.3955928917389733, 0.40178716764727573, 0.4078345648819584, 0.41376676442370813, 0.41962787140798374, 0.42547088344655476, 0.4313540528005064, 0.43733724483846254, 0.4434784134900477, 0.44983032775689974, 0.4564376868944082, 0.46333475225820164, 0.47054359993404093, 0.4780730617459664, 0.48591837718775893, 0.49406153106964384, 0.502472207483435, 0.511109255445978, 0.5199225387600828, 0.5288550333611733 ], [ 0.5000829392374653, 0.4855563922466463, 0.4707371155011436, 0.4557524478079934, 0.44074697889017417, 0.42588199010649785, 0.4113341584126481, 0.3972932575474448, 0.38395854770898935, 0.37153354463726307, 0.3602189419997756, 0.35020367230529936, 0.3416544579976949, 0.3347046987051281, 0.3294440484316729, 0.3259103588601692, 0.32408558896768586, 0.32389670697149514, 0.32522165626470945, 0.32789944138543353, 0.3317426747732968, 0.33655072033224315, 0.34212184651659283, 0.34826335536896974, 0.3547992450861316, 0.3615754271972516, 0.36846279623252104, 0.37535855938189716, 0.3821862299140353, 0.38889462586769924, 0.39545613528894175, 0.4018644350943937, 0.40813179367840985, 0.41428605074388236, 0.42036735022842125, 0.4264247001746387, 0.43251244247040554, 0.4386867305205675, 0.4450021288023955, 0.4515084597237227, 0.4582480257757356, 0.46525332561054183, 0.472545360416973, 0.48013259327176894, 0.4880105826998099, 0.49616226769386507, 0.5045588405437025, 0.5131611108757341, 0.5219212425208932, 0.5307847353533917 ], [ 0.5002373173784129, 0.48573525287953484, 0.47093797483991795, 0.4559713752721543, 0.4409784237234659, 0.4261186479359185, 0.41156690476302304, 0.39751118272955765, 0.38414913363220976, 0.3716830258834646, 0.3603128864834491, 0.35022779614413635, 0.3415956519165836, 0.334552192181007, 0.32919058451841027, 0.32555321689516514, 0.32362729425518133, 0.32334531436863473, 0.3245905763489906, 0.3272068648169659, 0.33101071229354995, 0.33580439657253697, 0.34138806899466106, 0.34756994209802444, 0.35417405307064265, 0.3610455916375388, 0.36805407070998364, 0.37509473944951904, 0.3820886428931866, 0.3889816746804819, 0.3957428911233666, 0.40236228086519144, 0.4088481265812859, 0.41522405708170435, 0.4215258686699499, 0.42779819032310523, 0.4340910737889332, 0.4404566021731242, 0.44694562399921584, 0.4536047292682151, 0.4604735856578228, 0.4675827439527436, 0.47495200123510767, 0.48258937957431597, 0.4904907401933177, 0.4986400129456587, 0.507009983394647, 0.5155635492012548, 0.5242553368458942, 0.533033560080609 ], [ 0.5006525482136643, 0.4862002227817717, 0.4714512436129499, 0.456529868076879, 0.4415772007728603, 0.4267507039707237, 0.4122230253003376, 0.3981798932423718, 0.3848167868635431, 0.3723340784718959, 0.36093041419175964, 0.3507942811863683, 0.342094041048936, 0.3349671702289909, 0.3295099441954659, 0.3257691521473988, 0.32373742558664137, 0.32335328686031684, 0.32450614972679165, 0.3270455133674315, 0.33079283564738887, 0.33555428565548695, 0.3411327707376634, 0.34733813506641636, 0.3539950033411269, 0.360948219490014, 0.3680661316844541, 0.37524210904803373, 0.38239469005633286, 0.3894667115212255, 0.39642369209778805, 0.40325167133866735, 0.40995464715132973, 0.416551715123829, 0.4230739917627981, 0.4295613970396814, 0.43605937552065704, 0.44261564510368584, 0.44927707329220706, 0.45608678858327845, 0.4630816352561838, 0.47029007117210375, 0.47773058936790963, 0.4854107163547395, 0.4933266059362625, 0.5014632110361167, 0.5097949818276477, 0.5182870102536727, 0.5268965214882544, 0.5355746031716963 ], [ 0.5012897511275209, 0.4869085310243077, 0.47223008849922293, 0.4573768942759079, 0.44248799216812623, 0.4277185316473789, 0.4132386444342314, 0.3992314260357631, 0.38588973978656677, 0.3734115511320653, 0.36199355923904153, 0.35182306298231775, 0.343068308695363, 0.33586800554741525, 0.33032117454346893, 0.32647885111594327, 0.32433918907377307, 0.32384708992218275, 0.3248986628238061, 0.3273498616798466, 0.33102788446703135, 0.33574359706012097, 0.3413033909661436, 0.3475193479303137, 0.35421714227862994, 0.3612415876131053, 0.3684600460502017, 0.3757640654960494, 0.38306963662460997, 0.3903164181778428, 0.3974662088338826, 0.4045008728717765, 0.4114198687558061, 0.41823748925231136, 0.42497989838026956, 0.4316820414533944, 0.4383845056647866, 0.4451304156835209, 0.4519624571811794, 0.4589201270367731, 0.4660373088557032, 0.4733402641926779, 0.480846112781666, 0.4885618500699571, 0.49648391983161594, 0.5045983270241452, 0.5128812451224449, 0.5213000463065001, 0.5298146645130115, 0.5383791916162476 ], [ 0.5021077586650693, 0.4878148961575322, 0.4732249305297177, 0.45845843013686366, 0.4436522316448123, 0.4289589896413444, 0.41454609670785425, 0.4005937459264526, 0.38729186575456287, 0.37483564607309333, 0.3634194273398809, 0.3532288813879288, 0.34443170175390275, 0.33716743487975, 0.3315375439665622, 0.32759715008484425, 0.3253499504142037, 0.3247474432922466, 0.32569283169309476, 0.32804905877718354, 0.33164967052950767, 0.33631084445867576, 0.34184302094010327, 0.3480609937215389, 0.3547918494344114, 0.36188061689391754, 0.36919380673733254, 0.3766211824144033, 0.38407614220301267, 0.39149505811872054, 0.39883585282046957, 0.4060760272048192, 0.41321029375162094, 0.4202479292476782, 0.42720993538217855, 0.4341260842909725, 0.44103192466409746, 0.4479658283858028, 0.45496616377029164, 0.46206868558830444, 0.4693042312473202, 0.47669680472050424, 0.4842621144460196, 0.49200660917485883, 0.4999270286412918, 0.5080104568645759, 0.5162348380920688, 0.524569891813326, 0.5329783460835132, 0.541417398696026 ], [ 0.5030640300151388, 0.4888725498981186, 0.47438458914348175, 0.45971873484201925, 0.44500951986889437, 0.4304069868963914, 0.4160756488683813, 0.4021926291782329, 0.3889447243837856, 0.37652412033602833, 0.36512254011475503, 0.3549237460013286, 0.34609458626053435, 0.3387751651751821, 0.3330691532934442, 0.329035602953348, 0.3266837131795536, 0.32597166971874925, 0.3268099907403218, 0.32906893736280257, 0.33258879915639933, 0.33719148021191353, 0.3426918598827596, 0.3489077756184667, 0.3556679796623291, 0.36281788378874497, 0.37022323211519936, 0.3777720150984553, 0.3853749893899082, 0.39296514445610364, 0.4004963984849261, 0.40794174087806173, 0.4152909818443493, 0.4225482274478797, 0.4297291716185546, 0.43685828291956597, 0.44396595983774306, 0.4510857301759499, 0.458251574014048, 0.46549545228582634, 0.4728451215770606, 0.48032230849648594, 0.4879413032538922, 0.49570801245235474, 0.5036194872102726, 0.5116639169934172, 0.5198210546927221, 0.5280630170789911, 0.536355388738621, 0.5446585480119753 ], [ 0.5041155597811057, 0.4900342499198611, 0.47565740745673923, 0.46110159659803435, 0.4464989993100105, 0.43199699325803337, 0.4177571516689058, 0.40395345943057337, 0.3907695010567224, 0.3783943635989473, 0.36701703996736734, 0.3568192498881548, 0.34796684422344937, 0.3406003206330546, 0.33482539447629683, 0.33070491005071184, 0.32825347672954586, 0.3274359451453077, 0.3281702055855346, 0.3303339688275169, 0.3337744553123485, 0.3383195101878855, 0.34378866327402086, 0.3500029787545807, 0.35679301200969626, 0.3640046419126402, 0.3715028768099156, 0.3791739171826541, 0.3869258224216315, 0.3946881158171152, 0.40241061036671805, 0.41006167640620805, 0.4176261164304949, 0.425102769784167, 0.4325019414779444, 0.43984273349989605, 0.4471503505349303, 0.45445345144338717, 0.4617816197099556, 0.4691630272678356, 0.4766223641603588, 0.48417909978481516, 0.4918461293188538, 0.4996288417410094, 0.5075246249396, 0.5155228007502739, 0.523604960666467, 0.5317456536152882, 0.5399133623038407, 0.5480716952398096 ], [ 0.5052197580237514, 0.49125325443909085, 0.4769923277612579, 0.46255151509324993, 0.44806064910470184, 0.4336644512291143, 0.4195215715773676, 0.40580288041733253, 0.3926887790093709, 0.38036528451041385, 0.36901868124927295, 0.35882865114901386, 0.34996002570589035, 0.3425536400177202, 0.3367171632544097, 0.33251711330527756, 0.32997338045495794, 0.32905736073937963, 0.32969422627994716, 0.3317690875968223, 0.33513608641745757, 0.33962902963176994, 0.34507213274913534, 0.35128972021545124, 0.3581141696047758, 0.3653918240677775, 0.3729869295262177, 0.3807838484811735, 0.3886878791998357, 0.3966250061969099, 0.4045408635544141, 0.4123991349144811, 0.4201795597158031, 0.4278756722068736, 0.4354923699215036, 0.44304339039504453, 0.4505487661925904, 0.4580323255773874, 0.4655193061796051, 0.47303414900121526, 0.48059853775248745, 0.48822974234034106, 0.49593931465513075, 0.5037321698533044, 0.5116060681316713, 0.5195514921499862, 0.5275518956891391, 0.5355842816957885, 0.5436200540805172, 0.5516260784755134 ], [ 0.5063352819311107, 0.49248423688612836, 0.47833989338847777, 0.4640147942179206, 0.44963647156737413, 0.4353470582409881, 0.42130236953936834, 0.40767027040421283, 0.3946281067306264, 0.3823589660609201, 0.3710465659317368, 0.36086867814051926, 0.3519892094403669, 0.34454937496882704, 0.3386587741342784, 0.33438750425354113, 0.33176057984034224, 0.33075574243339795, 0.3313052280444093, 0.33330133474707774, 0.33660493559890303, 0.34105563830674207, 0.34648221065404156, 0.3527121251231997, 0.3595794830564616, 0.36693100144664287, 0.37463007834213863, 0.38255915768170407, 0.3906207030678169, 0.39873709736003127, 0.4068497477087882, 0.4149176219266757, 0.4229153893364899, 0.4308312959901263, 0.4386648730323348, 0.4464245572291617, 0.4541252919181568, 0.4617861719258458, 0.46942819440637645, 0.47707217647836825, 0.48473689789115615, 0.49243752131040036, 0.5001843334938824, 0.5079818377093726, 0.5158282119944734, 0.5237151305620187, 0.5316279283839387, 0.539546073320425, 0.5474438974367813, 0.5552915302802315 ], [ 0.5074228040526328, 0.4936841246801901, 0.47965316018266857, 0.4654405277192615, 0.4511715527095166, 0.43698590179875757, 0.4230367094886621, 0.409489021701908, 0.3965173449561058, 0.3843020753267549, 0.37302461009109317, 0.362861045290469, 0.3539745589546001, 0.3465068755505028, 0.34056956238470304, 0.336236227398184, 0.33353683436074083, 0.33245520562490527, 0.33293031534157896, 0.33486129568240985, 0.3381154000730367, 0.3425377103592692, 0.3479612561676167, 0.35421640765272655, 0.36113877840569775, 0.36857528332188594, 0.376388328997717, 0.3844583274653493, 0.3926848237466386, 0.4009865447999034, 0.40930064704037333, 0.4175813898052559, 0.4257984109121635, 0.43393473709780134, 0.4419846298684493, 0.44995134586680496, 0.45784487824466436, 0.46567973906601084, 0.47347283975126914, 0.4812415245998068, 0.48900180955475314, 0.49676687324675567, 0.5045458392646414, 0.5123428775009192, 0.520156638854713, 0.5279800225532473, 0.5358002601557074, 0.5435992862609876, 0.5513543542251704, 0.5590388466575016 ], [ 0.5084457064358366, 0.4948128514884113, 0.4808885073196898, 0.4667814682680167, 0.45261498843477016, 0.43852644086063575, 0.4246664921788178, 0.4111976235306176, 0.39829179461791153, 0.3861270322212666, 0.374882749012394, 0.36473369001071004, 0.3558425865474416, 0.34835187601075224, 0.342375185260394, 0.3379895890110561, 0.3352298140995351, 0.33408544807249857, 0.3345017883486623, 0.3363843273208015, 0.3396062071720821, 0.3440175093335718, 0.3494550921785016, 0.35575184568319757, 0.3627445784460905, 0.3702801465841079, 0.3782197663581003, 0.3864416731996141, 0.394842399596375, 0.40333697042569133, 0.41185829035975086, 0.42035595183550306, 0.4287946423141271, 0.4371522861054369, 0.4454180227486347, 0.45359010100369834, 0.461673753237406, 0.46967910697769943, 0.4776191861641071, 0.48550805189272733, 0.4933591294188759, 0.5011837635371834, 0.5089900374747464, 0.5167818809461558, 0.5245584813882683, 0.5323139993901721, 0.5400375759935161, 0.5477136069759692, 0.5553222484694144, 0.562840110093476 ], [ 0.5093706939366944, 0.4958340170139973, 0.48200634269953796, 0.46799477682715623, 0.45392067550277276, 0.43991933532629207, 0.42613921957526596, 0.41274055736873205, 0.39989311917657117, 0.38777295515198373, 0.3765579031438263, 0.3664217567397583, 0.3575271539818293, 0.35001751109711954, 0.34400865265924263, 0.339581099766728, 0.3367741501562816, 0.33558280163709536, 0.33595818747971873, 0.3378115853918433, 0.3410214139724995, 0.3454421503482891, 0.3509139218296768, 0.35727164575269366, 0.36435291261125424, 0.37200418950208414, 0.3800852531075675, 0.3884719893138694, 0.397057815620688, 0.4057540168692325, 0.4144892666669465, 0.4232085640467095, 0.4318717663910021, 0.4404518560706654, 0.44893304400080797, 0.45730878900799193, 0.4655797961584501, 0.4737520478340178, 0.4818349160380731, 0.489839401054188, 0.4977765384344937, 0.5056560121000861, 0.5134850053332682, 0.5212673133735736, 0.529002731397561, 0.5366867204407411, 0.5443103421338036, 0.5518604419053876, 0.5593200504405373, 0.5666689654037498 ], [ 0.5101683232637578, 0.4967154521361369, 0.48297170244058385, 0.469042654057317, 0.45504797175053624, 0.4411211314465444, 0.42740870149756327, 0.4140690208376308, 0.4012700820956835, 0.3891864091801949, 0.37799473516077203, 0.36786836249343313, 0.3589702474485487, 0.35144510233965487, 0.34541112688761627, 0.3409522894421807, 0.3381122640402761, 0.33689107372752203, 0.33724514163396013, 0.339090872001911, 0.342311245293183, 0.3467644193145316, 0.3522931204486615, 0.3587337006978567, 0.3659240352929899, 0.3737098077939834, 0.3819490626179132, 0.39051513966375545, 0.3992982332772091, 0.4082058595241706, 0.4171625026551429, 0.4261086715601905, 0.43499954946020536, 0.4438033762470857, 0.4524996676915388, 0.46107735016489965, 0.4695328724608213, 0.4778683457597654, 0.4860897565715452, 0.494205293610435, 0.5022238263430252, 0.510153569165424, 0.5180009600298626, 0.5257697755133716, 0.5334604958735266, 0.541069923978093, 0.5485910517768536, 0.5560131579774968, 0.5633221115657386, 0.5705008484369033 ], [ 0.5108134468818893, 0.4974296900531901, 0.48375474708051275, 0.46989285878848175, 0.45596223352427834, 0.44209481453359434, 0.4284356197890113, 0.4151414996918179, 0.4023791235800543, 0.3903219854168134, 0.37914623128677744, 0.36902518097260295, 0.36012256690367017, 0.3525847562903513, 0.34653253399243683, 0.34205333506886615, 0.3391950148586006, 0.33796221338553245, 0.3383160502859796, 0.3401773282485292, 0.3434327894310637, 0.34794346344163046, 0.3535539125512344, 0.36010124582582137, 0.3674230553666615, 0.37536379345890664, 0.3837794447821444, 0.39254058958710397, 0.4015340891742792, 0.41066367314587365, 0.41984969899206265, 0.4290283165799462, 0.43815022309505164, 0.447179149700158, 0.45609018499924203, 0.46486801363046265, 0.4735051300675711, 0.48200007613776435, 0.49035574378988966, 0.49857778034027367, 0.5066731301746856, 0.5146487434761159, 0.5225104781725758, 0.5302622155521112, 0.5379052028370547, 0.5454376277201745, 0.5528544209459448, 0.5601472741082677, 0.5673048515998591, 0.574313168692164 ], [ 0.5112855727433595, 0.4979543459932404, 0.4843311590255119, 0.47051912048492256, 0.45663524005380085, 0.44281024191755847, 0.4291879665408135, 0.41592420831257715, 0.4031848010149922, 0.3911427401329512, 0.379974139181302, 0.36985288091510643, 0.36094396812813223, 0.35339581476202103, 0.3473320272244294, 0.342843542327016, 0.3399822020116847, 0.3387568364704005, 0.3391326296989974, 0.3410339973965509, 0.344350572157643, 0.3489453686880228, 0.35466394510745874, 0.3613434209188405, 0.3688204810072384, 0.3769378579205948, 0.3855491244784868, 0.3945218780016672, 0.40373954017616737, 0.41310205010665435, 0.42252572236785707, 0.4319425051622441, 0.44129882668542464, 0.45055417278827686, 0.4596795017781767, 0.4686555742842218, 0.47747125679020885, 0.48612184497080235, 0.49460744534686973, 0.5029314491275555, 0.5110991288535844, 0.5191163853901736, 0.5269886691114116, 0.5347200943111936, 0.5423127598448947, 0.5497662819137457, 0.5570775371333025, 0.564240606101561, 0.5712469001775811, 0.5780854476447838 ], [ 0.5115691419862414, 0.4982724091468298, 0.4846824467340927, 0.4709014533513846, 0.45704551490795897, 0.4432444690873134, 0.42964137237321126, 0.4163914179652524, 0.4036601157156424, 0.3916205195016056, 0.38044929141688266, 0.3703214504382638, 0.3614037914055113, 0.35384719235131573, 0.34777833838406913, 0.3432917153689098, 0.3404429569544188, 0.3392446408735514, 0.33966535073093124, 0.34163228204159607, 0.34503702806959224, 0.3497436389261806, 0.3555977677772884, 0.3624357451660564, 0.3700926838351563, 0.3784090810637403, 0.38723573236824127, 0.3964370279037675, 0.40589285239692474, 0.4154993673011489, 0.4251689501432344, 0.43482952969781596, 0.44442350801032005, 0.4539064142064323, 0.46324539657931824, 0.4724176303841472, 0.48140869845850276, 0.4902109885379322, 0.4988221429799172, 0.5072435916964025, 0.5154791958666904, 0.5235340272536916, 0.5314133048310351, 0.5391215064419986, 0.5466616681594162, 0.5540348779712565, 0.5612399636623329, 0.5682733677249081, 0.5751291953057984, 0.5817994150781222 ], [ 0.5116537273307991, 0.4983724508737089, 0.4847961612539431, 0.4710263795145876, 0.4571785540217103, 0.44338198077992524, 0.429779338988086, 0.4165256896010796, 0.40378674537002884, 0.39173619189435827, 0.3805518388321449, 0.37041043371554816, 0.36148110477849554, 0.3539176302489146, 0.34785004639914974, 0.34337644397627076, 0.3405560516508795, 0.339404737306698, 0.33989379099080186, 0.3419523147111701, 0.3454728851459677, 0.3503195890295442, 0.3563372288530702, 0.36336051063286134, 0.37122228532708784, 0.3797602869215186, 0.38882216710803513, 0.39826889313604213, 0.4079767311537801, 0.41783809833293645, 0.42776156408908445, 0.4376712437036913, 0.4475057787208439, 0.4572170509427305, 0.4667687370383273, 0.4761347805638622, 0.48529783696654266, 0.4942477332185579, 0.5029799751376588, 0.5114943303461286, 0.5197935116473628, 0.527881983150468, 0.5357649088854365, 0.5434472603844749, 0.5509330955089449, 0.558225015675985, 0.5653238027850496, 0.5722282309072175, 0.5789350416051161, 0.5854390660421004 ], [ 0.5115341550199771, 0.49824875307958094, 0.4846660302320128, 0.4708870677969249, 0.4570269683700118, 0.4432148367926029, 0.4295933875727988, 0.4163180246509397, 0.40355519749507746, 0.3914798048600342, 0.3802714125527536, 0.370109100215517, 0.3611648832260254, 0.3535958883745721, 0.34753578535692325, 0.343086329872475, 0.3403101445095571, 0.33922591479207537, 0.33980691826215775, 0.34198325618840364, 0.34564747392456596, 0.35066266037607374, 0.3568717926196981, 0.36410709746906345, 0.3721984665469483, 0.3809803453284245, 0.3902968869559106, 0.4000054384514499, 0.40997858829885675, 0.4201050670925058, 0.4302897892737169, 0.44045328513839704, 0.4505307212758983, 0.4604706581512556, 0.4702336521922476, 0.479790778355595, 0.4891221270732638, 0.49821531498292293, 0.5070640399205166, 0.5156667054305051, 0.5240251369672873, 0.5321434098041536, 0.540026806556439, 0.547680919595409, 0.5551109101852051, 0.5623209318588575, 0.5693137204950514, 0.576090348041726, 0.5826501312209341, 0.5889906812396684 ], [ 0.5112105529018882, 0.4979013600899634, 0.48429201356072393, 0.47048339318386034, 0.4565905474221459, 0.4427427397608005, 0.42908313146470467, 0.4157679434130587, 0.40296489469135305, 0.39085067870341256, 0.3796072276300161, 0.369416560326855, 0.36045413823724626, 0.35288089067320677, 0.3468344068234735, 0.3424201665937064, 0.3397039773130191, 0.33870685302196163, 0.33940331561479387, 0.34172352994269434, 0.3455589674962869, 0.35077066278513985, 0.3571987801049789, 0.36467221102162295, 0.37301719985211207, 0.3820643969996469, 0.3916541273497143, 0.40163994885762505, 0.41189074257696345, 0.4222916382635056, 0.43274407371745016, 0.4431652441060391, 0.453487143575319, 0.4636553496702326, 0.47362765801552215, 0.4833726421420893, 0.4928681904998254, 0.5021000577347037, 0.5110604581479502, 0.519746723990743, 0.5281600482962805, 0.536304330085924, 0.5441851381178775, 0.5518088072867064, 0.5591816790031029, 0.5663094932824979, 0.5731969359285879, 0.5798473393338184, 0.5862625303463526, 0.5924428137288283 ], [ 0.5106883267513381, 0.4973360564985041, 0.48368028356053, 0.4698219203473919, 0.4558762472349303, 0.4419730292834755, 0.4282562779967066, 0.4148834964990873, 0.40202419769429587, 0.38985744316455895, 0.37856813524346433, 0.36834183466939024, 0.3593580052985229, 0.3517818311142085, 0.34575510377244023, 0.34138707972873317, 0.33874652912508085, 0.33785628644628934, 0.33869135170242254, 0.34118099466499363, 0.3452145527933207, 0.3506499419306517, 0.35732353100454034, 0.3650600376022831, 0.37368139853193605, 0.3830139974334795, 0.39289403950455865, 0.4031711631236531, 0.41371054788722594, 0.42439383976976, 0.4351192040822578, 0.4458007705756606, 0.4563676773624134, 0.46676286577265286, 0.47694173332949646, 0.48687071829251605, 0.4965258656960329, 0.5058914094949837, 0.5149583961439284, 0.5237233697085358, 0.532187135832722, 0.540353620319703, 0.5482288368325808, 0.555819976676358, 0.5631346314377735, 0.5701801562942966, 0.576963178096577, 0.5834892480532579, 0.5897626342718485, 0.5957862448541064 ], [ 0.5099780662809509, 0.49656427245933826, 0.4828431311681663, 0.4689158126734706, 0.4548981045894394, 0.44092060373627484, 0.4271285607831875, 0.41368121050297946, 0.40075036728166397, 0.38851801814416576, 0.37717262428208526, 0.36690387774129385, 0.35789578971584934, 0.3503182404856992, 0.34431749574094733, 0.3400066265000461, 0.33745712533185157, 0.3366931172953527, 0.33768929244613927, 0.34037305013930585, 0.3446305275668239, 0.3503154659901506, 0.3572594801336737, 0.36528231207514056, 0.37420097754227294, 0.38383717294129477, 0.3940227435762044, 0.4046033253092618, 0.4154404436737271, 0.42641241179596173, 0.4374143524758838, 0.4483576176787319, 0.4591688164764063, 0.46978860477697815, 0.4801703432826462, 0.4902786952628581, 0.5000882116433316, 0.5095819353759681, 0.518750047754042, 0.5275885742331292, 0.5360981647669244, 0.5442829624166705, 0.5521495731385854, 0.5597061485837115, 0.5669615920923312, 0.5739248956675936, 0.5806046125746146, 0.5870084664678905, 0.5931430938322187, 0.5990139123175767 ], [ 0.5090953816037385, 0.4956029168433883, 0.48179879812697973, 0.4677846662833938, 0.45367707607529123, 0.43960776801977247, 0.42572359997983156, 0.4121859646749733, 0.3991694610520027, 0.38685953372566495, 0.37544876680708295, 0.3651315496747839, 0.3560969638195075, 0.3485200062885706, 0.342551666738813, 0.33830884539447453, 0.33586549169768615, 0.33524646665006913, 0.3364253425997875, 0.3393266645759612, 0.3438323111184374, 0.34979081985469485, 0.35702813727321436, 0.36535828687820215, 0.37459281581186177, 0.38454838017668524, 0.3950522886331989, 0.405946147373726, 0.41708792125017546, 0.4283527768735231, 0.439633049500163, 0.45083761631927394, 0.4618908912731027, 0.4727315954076718, 0.4833114078544936, 0.4935935666694068, 0.5035514642491026, 0.513167266432091, 0.5224305751971856, 0.5313371499782326, 0.5398877003390385, 0.5480867618346948, 0.5559416664182073, 0.5634616181204576, 0.5706568835616063, 0.5775381049630777, 0.5841157407004868, 0.5903996351750042, 0.5963987160827505, 0.6021208132875366 ], [ 0.5080606702791575, 0.49447413770018595, 0.4805712337835341, 0.4664542666661474, 0.4522407986067356, 0.43806400246187466, 0.42407268436159307, 0.41043079099186897, 0.39731615597200326, 0.3849181788979917, 0.37343409534082533, 0.36306352264607694, 0.35400110077214547, 0.34642732970835277, 0.3404981387404589, 0.33633423765409254, 0.33401173442823967, 0.3335556440341781, 0.33493759756227365, 0.3380783041482308, 0.34285435040275763, 0.3491080898282938, 0.35665895496044964, 0.36531458880848167, 0.37488060823761826, 0.38516835896375734, 0.396000510747184, 0.4072146754833024, 0.41866539979247336, 0.4302249257109958, 0.44178307903211894, 0.4532465772909928, 0.46453797603914365, 0.47559440730903624, 0.48636621332738944, 0.4968155417925942, 0.5069149442803992, 0.5166460038077697, 0.5259980086227501, 0.5349666846909171, 0.5435529974023507, 0.5517620324572301, 0.5596019658000577, 0.5670831322515062, 0.5742172017552573, 0.5810164707248672, 0.5874932738037455, 0.5936595185218869, 0.5995263420188459, 0.6051038854373403 ], [ 0.5068988146047222, 0.4932050086750092, 0.4791897739110035, 0.46495626388766675, 0.450623265657743, 0.43632564527132583, 0.4222144655403027, 0.4084565857247575, 0.39523348248134393, 0.3827389624239066, 0.3711753931157761, 0.3607481008559105, 0.3516577218286599, 0.3440905946507331, 0.33820775415533355, 0.3341336527977257, 0.3319462176704839, 0.3316700068351506, 0.33327387734350833, 0.3366737379945729, 0.34173989680463396, 0.3483076166797415, 0.356189064935, 0.3651849471780446, 0.3750945937250494, 0.38572386724632557, 0.3968907801398744, 0.4084290527152179, 0.42019000612957325, 0.43204321405514484, 0.443876290959082, 0.4555941178902111, 0.46711772703311455, 0.4783829979019762, 0.48933926540982886, 0.4999479026446393, 0.5101809163882074, 0.520019578125987, 0.5294531046904396, 0.5384773984644986, 0.5470938555012372, 0.555308249719623, 0.5631297016201945, 0.5705697401271521, 0.5776414658307558, 0.5843588228815246, 0.5907359850248751, 0.5967868588252208, 0.6025247041636945, 0.6079618688157339 ], [ 0.5056388086066864, 0.491827139546003, 0.4776887381438216, 0.4633277610714848, 0.44886441170257174, 0.4344354785087085, 0.42019455147946044, 0.4063117166076422, 0.392972451023505, 0.3803753633905094, 0.3687283714911926, 0.3582429250739018, 0.3491260250620916, 0.34157011424412836, 0.33574143058848477, 0.33176804008375105, 0.329729299830764, 0.32964867143003096, 0.33149140615265693, 0.3351676847885173, 0.3405406231682605, 0.3474375906322496, 0.35566286101717753, 0.36500977517617755, 0.37527114479643775, 0.38624728686353776, 0.39775162872802994, 0.40961417161348146, 0.42168325344536134, 0.4338260669780588, 0.44592832925298914, 0.4578934111792869, 0.4696411499172364, 0.4811064948423745, 0.4922380836852045, 0.5029968076351843, 0.5133543995789676, 0.5232920647708467, 0.5327991651036746, 0.5418719643899921, 0.5505124409099185, 0.5587271736689113, 0.5665263094557774, 0.5739226183125109, 0.5809306450573909, 0.5875659638476731, 0.5938445413703618, 0.5997822121592907, 0.6053942668881049, 0.6106951514755747 ], [ 0.5043133143373313, 0.4903762089933693, 0.4761069422734291, 0.4616108101377716, 0.44700959616147307, 0.4324422057538196, 0.41806498394308883, 0.4040515063196817, 0.3905915474803677, 0.37788884348116303, 0.36615720207858365, 0.35561452491022955, 0.3464744546763871, 0.3389357104678975, 0.33316974093833446, 0.3293080174774117, 0.32743088016255195, 0.3275600288790859, 0.329656293395986, 0.33362326089491007, 0.3393160462530566, 0.3465534590667018, 0.35513140476537997, 0.3648355859430117, 0.37545220477537006, 0.3867760899035217, 0.39861625080635377, 0.4107992116462227, 0.42317061568224346, 0.4355955886700763, 0.4479582744084374, 0.46016085761642117, 0.47212229680546886, 0.483776914690137, 0.4950729382920311, 0.5059710429805169, 0.5164429304814414, 0.5264699565915731, 0.5360418167895362, 0.545155294696493, 0.5538130776348182, 0.5620226441084256, 0.5697952290266824, 0.5771448733477077, 0.5840875651741405, 0.5906404790066073, 0.5968213187863316, 0.6026477685793724, 0.6081370523909696, 0.6133056018275057 ], [ 0.5029581476995107, 0.48889141822017845, 0.47448712198748216, 0.4598518088561489, 0.4451089778440661, 0.430399808831775, 0.41588358303522527, 0.40173757068203547, 0.3881560706774912, 0.37534818855156216, 0.3635338654195266, 0.3529376750311674, 0.3437800619453056, 0.33626607361438127, 0.3305722624808392, 0.3268332003877569, 0.325129698479797, 0.32548101071407803, 0.32784276620379194, 0.33211118632013087, 0.33813271779251014, 0.3457171172957916, 0.3546516310804922, 0.36471422655535707, 0.3756845607948493, 0.38735215790491256, 0.3995218722160873, 0.4120170591863194, 0.4246809968980326, 0.43737707812715226, 0.4499882014069669, 0.4624156807287584, 0.47457789493926655, 0.4864088200130736, 0.49785653119343865, 0.5088817242984445, 0.5194562819066446, 0.5295618965669087, 0.5391887563004227, 0.5483342949926587, 0.5570020100336749, 0.5652003505264969, 0.5729416807151544, 0.58024132444265, 0.5871166970992725, 0.593586531482866, 0.5996702032043703, 0.6053871597684832, 0.6107564553496749, 0.61579639073271 ], [ 0.501611695175056, 0.48741486523198607, 0.4728752658022671, 0.4581007943406512, 0.4432167717611941, 0.42836677151447133, 0.41371314205935994, 0.399436989381386, 0.38573728368799753, 0.37282864463207377, 0.36093727445941537, 0.35029450677812035, 0.34112760303349354, 0.33364784179498796, 0.32803663186912463, 0.3244312261186947, 0.3229123255773155, 0.3234960466574398, 0.326132101809659, 0.3307087047886223, 0.33706314914564756, 0.3449958558674094, 0.354285334856084, 0.3647019174644914, 0.37601894529231256, 0.3880209504433721, 0.40050898733363866, 0.41330361128207777, 0.42624609811679004, 0.43919845406679087, 0.45204265699721713, 0.46467945084397083, 0.47702691108056866, 0.4890189189943319, 0.5006036260275908, 0.5117419522739592, 0.5224061404681539, 0.5325783740800719, 0.5422494619788567, 0.5514175900550279, 0.5600871404166609, 0.5682675801096222, 0.5759724229535887, 0.58321826951871, 0.5900239311758818, 0.59640964436699, 0.6023963807021189, 0.6080052572289678, 0.6132570493356678, 0.6181718063952237 ], [ 0.5003142645911509, 0.4859908415470885, 0.47131985709046553, 0.45641063041560354, 0.44139038255880986, 0.42640516048304444, 0.4116204581539387, 0.39722128895975456, 0.38341135211848243, 0.3704108142988443, 0.35845213113291413, 0.3477733259630035, 0.3386083176538657, 0.3311743391155332, 0.3256572416162301, 0.3221964094453992, 0.32087178280141593, 0.32169565874180955, 0.3246112125876328, 0.3294981803732919, 0.3361844417712378, 0.34446104567856917, 0.35409792765193987, 0.3648580924544478, 0.376508965576785, 0.38883052583336347, 0.4016204686561577, 0.41469696921742594, 0.4278996883092622, 0.4410895959461896, 0.45414806314414524, 0.46697554355379967, 0.47949005802445754, 0.4916256136289175, 0.5033306322914846, 0.51456642781804, 0.5253057483700462, 0.535531389618884, 0.5452348784339447, 0.5544152254739717, 0.5630777457312657, 0.571232947760419, 0.5788954942448603, 0.5860832382284982, 0.5928163404704873, 0.5991164738108389, 0.6050061201094642, 0.610507964269248, 0.6156443881680645, 0.6204370651486841 ], [ 0.49910737543570066, 0.4846650559026195, 0.46987102834707467, 0.45483608998731834, 0.4396894129988036, 0.4245795584491522, 0.4096751891605128, 0.3951652231187587, 0.38125804807770003, 0.36817928498500674, 0.35616748005720367, 0.34546709336798914, 0.33631833849709897, 0.3289439176526536, 0.32353352107173944, 0.32022797352943205, 0.3191057396599414, 0.3201746483986028, 0.3233708499834308, 0.32856534727744013, 0.33557660995295724, 0.34418655574474843, 0.35415696580464984, 0.36524404521966575, 0.3772098705949471, 0.3898304247875226, 0.40290056058631596, 0.41623653357708135, 0.4296767909246826, 0.4430816119757021, 0.4563320568926709, 0.469328542462104, 0.4819892520912554, 0.49424850470230886, 0.5060551514245263, 0.5173710337064061, 0.5281695158194668, 0.5384340938782152, 0.5481570788756113, 0.5573383503191512, 0.5659841781525478, 0.5741061126424878, 0.5817199440749888, 0.5888447359843352, 0.5955019369549752, 0.6017145766478565, 0.6075065515586909, 0.6129020051434689, 0.6179248054334965, 0.6225981212432736 ], [ 0.49803299718797756, 0.4834837931239587, 0.4685796351836167, 0.45343283874942425, 0.4381745520488072, 0.4229558515058344, 0.407948535469465, 0.3933453448546911, 0.3793592092277706, 0.36622097277938753, 0.35417493664157523, 0.3434715392213035, 0.33435669768804316, 0.32705786643578766, 0.3217677648759442, 0.3186278222600754, 0.3177142618676208, 0.3190298576223246, 0.32250341826553397, 0.3279972132163402, 0.3353206043225592, 0.3442469182255839, 0.35453046847591746, 0.3659214030665592, 0.37817717594458156, 0.39107043762566945, 0.4043937769454328, 0.4179620189717799, 0.4316128026431931, 0.44520604932151187, 0.4586227804419584, 0.47176359872494805, 0.48454703293570217, 0.4969078638358843, 0.5087954941332663, 0.5201723911965623, 0.531012611809879, 0.5413004083404696, 0.5510289117860272, 0.5601988867744926, 0.5688175550599337, 0.5768974863191593, 0.5844555574199406, 0.5915119833756743, 0.5980894246690034, 0.6042121763854538, 0.6099054446040042, 0.6151947147709858, 0.6201052154193799, 0.6246614787147139 ], [ 0.49713274754745146, 0.48249302061734645, 0.4674962628865018, 0.4522563331506682, 0.43690635522543414, 0.4215998825906593, 0.40651175739573525, 0.39183837902154395, 0.3777969589525249, 0.36462318472188515, 0.3525665894596021, 0.3418829087337527, 0.3328229257170066, 0.3256178831482629, 0.32046250736607357, 0.3174978578792255, 0.3167971211646517, 0.3183575240084701, 0.3221004259431365, 0.32787965066462516, 0.3354960745257735, 0.3447152806784325, 0.3552850651392325, 0.36695046525715064, 0.379465181768463, 0.3925992863841301, 0.4061437302429955, 0.4199124133061373, 0.43374256637282904, 0.4474940659870353, 0.4610481387040917, 0.47430576273210623, 0.48718595935405434, 0.49962408483111803, 0.5115701799270214, 0.5229874014889226, 0.5338505421716988, 0.5441446353774548, 0.5538636392184428, 0.5630091933673977, 0.5715894444369228, 0.5796179380023954, 0.5871125779033024, 0.5940946556263215, 0.6005879541550505, 0.606617931544407, 0.6122109896037984, 0.6173938324781115, 0.6221929186776946, 0.6266340083481654 ], [ 0.4964470661168612, 0.4817374596885098, 0.4666701844467145, 0.45136065326354663, 0.435943939549637, 0.42057599508936366, 0.40543455369941944, 0.3907194224345531, 0.37665171621156884, 0.3634714297128956, 0.351432608893233, 0.3407953733068769, 0.33181428118786044, 0.32472315207422253, 0.3197174931119727, 0.3169369016943623, 0.3164507323051639, 0.3182503013232616, 0.32224965028539515, 0.3282947520728576, 0.336178944759762, 0.34566121447001324, 0.3564840350993024, 0.36838846159001365, 0.38112543214910677, 0.3944632639424656, 0.40819192901893514, 0.42212491288038007, 0.4360994255074148, 0.44997558778841534, 0.46363504474002015, 0.47697930578328196, 0.489927996799359, 0.5024171282028898, 0.5143974311979307, 0.5258327830239752, 0.5366987247181606, 0.5469810666854102, 0.556674574644147, 0.5657817289287476, 0.5743115521384998, 0.5822785027455502, 0.589701434898247, 0.5966026269069682, 0.6030068825587913, 0.6089407103635, 0.614431586051828, 0.619507303152973, 0.6241954153464673, 0.6285227726274945 ], [ 0.49601438273068543, 0.4812596437137051, 0.4661482953057573, 0.45079729944674435, 0.4353436261364677, 0.41994550427209226, 0.4047833442237036, 0.3900600204626858, 0.37600005080324406, 0.36284704145091407, 0.3508586341793371, 0.3402981893281139, 0.33142270402244034, 0.32446713215008866, 0.3196263582783948, 0.3170373417450581, 0.3167648471217002, 0.3187940772377586, 0.3230321435040788, 0.32931807015254766, 0.3374389125514876, 0.3471484771692992, 0.35818532387612984, 0.37028780365086883, 0.3832051772582801, 0.3967048817387469, 0.41057658666761043, 0.42463386997235236, 0.43871429054174693, 0.45267847698067665, 0.466408675910504, 0.4798070515350184, 0.4927939138410545, 0.5053059740120881, 0.5172946751588317, 0.5287246163957832, 0.5395720719471307, 0.549823599369305, 0.5594747286645213, 0.5685287247241054, 0.5769954176948621, 0.5848900985672628, 0.5922324799586609, 0.599045724354825, 0.6053555437745581, 0.6111893758310585, 0.6165756414483086, 0.6215430890756195, 0.6261202291986572, 0.6303348613787704 ], [ 0.49587030284641315, 0.48109898960597103, 0.4659740560287421, 0.4506139896638129, 0.43515757398027954, 0.41976514805438064, 0.40461951750704794, 0.3899261919664393, 0.3759124686951434, 0.36282471273806643, 0.3509230546464064, 0.34047273812334944, 0.3317316439110773, 0.32493422411263717, 0.3202732060539357, 0.3178816998680245, 0.31781920059617746, 0.32006477824209223, 0.32451925890711525, 0.3310159047460744, 0.33933701267886374, 0.3492328505648994, 0.3604396388629733, 0.3726944139448185, 0.3857459087408933, 0.39936158430073837, 0.41333148997614466, 0.42746979306955474, 0.44161475173924436, 0.45562774102771963, 0.46939176503659913, 0.48280973809845085, 0.49580270564581075, 0.508308098748202, 0.5202780674378057, 0.5316779090252521, 0.5424845920241951, 0.5526853691763037, 0.5622764710212761, 0.5712618722550338, 0.5796521253285859, 0.587463258458433, 0.5947157378901023, 0.6014334965432567, 0.6076430328758713, 0.6133725848378311, 0.6186513841107407, 0.6235089954735479, 0.627974745158743, 0.6320772405733974 ], [ 0.4960468348178326, 0.4812909124619685, 0.46618647894026666, 0.4508535009638187, 0.43543245750720877, 0.420085580628218, 0.4049977201240361, 0.39037649508432776, 0.3764512384188778, 0.36347007336893056, 0.35169434088423496, 0.3413896276310713, 0.3328129689229177, 0.32619654304086027, 0.3217293179759235, 0.3195393670733029, 0.3196803550030412, 0.3221253952444181, 0.326769910153622, 0.3334428241892273, 0.34192340720481745, 0.3519601891965906, 0.3632887355931194, 0.37564622400455294, 0.3887820426316975, 0.40246459127518097, 0.4164849771758556, 0.4306584409104711, 0.44482427216099446, 0.4588448103752286, 0.4726039510636203, 0.4860054317530947, 0.49897106256097623, 0.51143899195868, 0.5233620510308561, 0.5347061916058007, 0.5454490186151878, 0.5555784101995085, 0.5650912171409199, 0.5739920340164009, 0.5822920366350687, 0.5900078829838743, 0.597160677518868, 0.6037750008808419, 0.6098780087974036, 0.6154986049629894, 0.6206666930337541, 0.6254125125559375, 0.6297660627257192, 0.6337566164517981 ], [ 0.4965716850364581, 0.48186601516651223, 0.4668191976347337, 0.4515526028216429, 0.43620824638888994, 0.4209499806613316, 0.4059642754689406, 0.39146024075210945, 0.37766838790018037, 0.3648374665818962, 0.35322860876969564, 0.3431060674004667, 0.3347241927784528, 0.32831105668221544, 0.32405027507647094, 0.32206378382614453, 0.3223990097410352, 0.3250234781649082, 0.3298282852975976, 0.336639612637445, 0.34523556269501415, 0.355364812335205, 0.3667640030140908, 0.37917192935938837, 0.39233982102193715, 0.4060379248715209, 0.4200590729119144, 0.4342200494605196, 0.4483614936476786, 0.4623469126326281, 0.4760612124844429, 0.4894090121755502, 0.5023129009521758, 0.5147117275004899, 0.5265589635793329, 0.537821157668665, 0.5484764795269235, 0.5585133498092307, 0.5679291469227964, 0.5767289839993498, 0.5849245509048914, 0.5925330187397094, 0.5995760067839995, 0.6060786140000867, 0.6120685188276399, 0.6175751520084013, 0.6226289475200227, 0.6272606764014205, 0.6315008673713147, 0.635379316767426 ], [ 0.49746764651646164, 0.4828493845758924, 0.46789965848539405, 0.45274113075560435, 0.43751714749785225, 0.42239284798147925, 0.40755582288914083, 0.39321596507240253, 0.37960400627781077, 0.36696808482745014, 0.3555676049111595, 0.34566373286165525, 0.33750626082499324, 0.3313173470847271, 0.3272737542635212, 0.32549032728372823, 0.3260080246017507, 0.328789324321933, 0.3337222123092909, 0.3406318103983309, 0.34929695335527755, 0.3594683529502042, 0.37088543996149737, 0.38329007607050625, 0.3964364931611399, 0.4100976722989003, 0.42406882095382004, 0.43816872573676124, 0.45223968419143973, 0.4661465672246331, 0.47977540405039903, 0.4930317468279953, 0.505838971557705, 0.5181366026842451, 0.5298787045565809, 0.5410323564099013, 0.5515762130519087, 0.5614991466214688, 0.5707989626271703, 0.579481183955138, 0.5875578983577979, 0.5950466672737419, 0.6019694961700156, 0.6083518686289927, 0.614221847938963, 0.6196092508938918, 0.6245448988284887, 0.6290599506222666, 0.633185321552114, 0.6369511905410676 ], [ 0.49875210430089023, 0.4842600233793278, 0.46944847035123216, 0.45444124519210566, 0.4393827647307535, 0.4244390575188355, 0.4097982615106853, 0.39567026302458574, 0.38228497365992997, 0.3698886098024328, 0.35873728057330523, 0.34908730603041593, 0.34118209736255406, 0.3352362065130401, 0.3314182103902848, 0.3298351063768957, 0.33052134028176405, 0.3334350225527722, 0.3384623144293585, 0.345428962855448, 0.35411638531927025, 0.3642791416326078, 0.37566108664773945, 0.3880085312707104, 0.40107981936867143, 0.4146515193611475, 0.42852184505580976, 0.4425120342643161, 0.45646634872893227, 0.4702512194699623, 0.4837539131817203, 0.49688096878657784, 0.5095565578347948, 0.5217208562414548, 0.5333284719596934, 0.5443469472114196, 0.5547553394270521, 0.5645428780095729, 0.5737076915657586, 0.5822556004052228, 0.5901989706322915, 0.5975556282384161, 0.6043478337355815, 0.6106013197405566, 0.6163443953395934, 0.6216071219326044, 0.6264205655353559, 0.6308161302151718, 0.6348249764957683, 0.6384775272679649 ], [ 0.5004366770617238, 0.48611044179595453, 0.471478942514257, 0.4566669127590494, 0.44181952246906414, 0.4271032264047519, 0.41270606629471684, 0.3988370639503263, 0.38572421281149627, 0.37361046393570946, 0.36274707262143396, 0.35338381894752524, 0.34575604314409514, 0.3400691927911918, 0.33648255948743744, 0.3350947660831367, 0.3359338812951425, 0.33895442242396273, 0.34404201104788923, 0.3510246228957125, 0.35968797900137367, 0.3697921566154541, 0.3810869381020074, 0.3933243614537349, 0.40626791893829206, 0.4196985742254252, 0.4334181550786766, 0.44725079156692477, 0.46104301720897384, 0.47466302653188497, 0.4879994472403618, 0.500959868006517, 0.5134692732341144, 0.5254684730866152, 0.5369125756001017, 0.5477695221499392, 0.5580186929711507, 0.5676495820588923, 0.576660537887954, 0.5850575661379199, 0.5928531917677512, 0.6000653795558497, 0.6067165141031692, 0.6128324419711825, 0.6184415799022817, 0.6235740938410992, 0.6282611536960023, 0.6325342684520545, 0.6364247054097184, 0.6399629960489505 ], [ 0.50252700865092, 0.4884064261600225, 0.4739968318150227, 0.4594236355318431, 0.4448323833500962, 0.4303894304771403, 0.4162820182376081, 0.4027173958902215, 0.38992051364456176, 0.37812972551436647, 0.36758994132400413, 0.3585428427577165, 0.35121421427246957, 0.34579915985947657, 0.3424468619640371, 0.3412472840637308, 0.34222241280727844, 0.34532399385607326, 0.3504383286614349, 0.3573970748247494, 0.3659917833996697, 0.37598952052918605, 0.38714732664612495, 0.39922411110116646, 0.41198945895723316, 0.42522948148181877, 0.43875020070797427, 0.4523790724653456, 0.46596521455867795, 0.47937880028737306, 0.49250995683459753, 0.505267401111342, 0.5175769622731105, 0.5293800804428705, 0.5406323312097601, 0.5513020003329454, 0.5613687183535193, 0.5708221570324847, 0.5796607861568204, 0.5878906885272641, 0.5955244316753879, 0.6025799962734419, 0.6090797627934273, 0.6150495594208696, 0.6205177753361193, 0.625514544128493, 0.6300710022542323, 0.6342186270830636, 0.637988658233321, 0.6414116046371006 ], [ 0.5050227165433779, 0.4911469927418993, 0.47700030877355665, 0.46270843932877564, 0.44841687234945643, 0.43429128226295516, 0.4205173593989646, 0.407299645792653, 0.39485893062930616, 0.3834276964931169, 0.37324313823489447, 0.36453747531193526, 0.35752571196802474, 0.3523916692997413, 0.3492738911189459, 0.3482536313582547, 0.34934721834359694, 0.3525044484366823, 0.357613404859548, 0.3645106789998488, 0.3729949396051502, 0.3828414786598182, 0.39381572375682394, 0.40568444501705025, 0.41822415778976907, 0.4312268082289115, 0.4445031604767577, 0.4578844202583384, 0.47122260775085834, 0.48439010451410236, 0.49727869406267317, 0.5097983196193756, 0.5218757059644259, 0.5334529362708568, 0.5444860365014632, 0.5549435952694277, 0.5648054321809212, 0.5740613194535176, 0.5827097576990927, 0.5907568055124894, 0.5982149627775584, 0.6051021086259677, 0.6114404962580342, 0.6172558080328655, 0.6225762751525026, 0.6274318667808422, 0.6318535534937283, 0.6358726495398737, 0.6395202375297658, 0.6428266779198308 ], [ 0.5079174966719123, 0.4943245256475952, 0.4804801403063806, 0.46651011653226715, 0.4525593991533893, 0.4387923569356416, 0.4253923510190183, 0.41256028199466505, 0.4005117032249537, 0.3894720518680474, 0.3796696071519175, 0.3713260011235752, 0.3646445273102166, 0.3597971004338126, 0.35691138532079364, 0.35606008657668003, 0.3572543903692279, 0.3604429273778438, 0.3655165109039228, 0.3723176875376355, 0.3806532696384705, 0.390307759165123, 0.40105588324450087, 0.41267309432585597, 0.424943557753981, 0.4376656681678323, 0.45065544088837545, 0.4637482422552617, 0.47679931643391205, 0.4896834965552741, 0.5022943985739023, 0.514543311468672, 0.526357927895168, 0.5376810073242428, 0.5484690272335926, 0.5586908538303544, 0.568326448798943, 0.5773656199218304, 0.5858068189807039, 0.5936559885608063, 0.600925459164719, 0.607632898649395, 0.6138003169321492, 0.6194531298377681, 0.6246192866682307, 0.6293284664405783, 0.6336113476906986, 0.6374989562623848, 0.6410220946118165, 0.6442108549093842 ] ] }, { "hoverinfo": "text", "legendgroup": "In-sample", "marker": { "color": "black", "opacity": 0.5, "symbol": 1 }, "mode": "markers", "name": "In-sample", "text": [ "Arm 0_0
hartmann6: -0.132631 (SEM: 0)
x1: 0.454046
x2: 0.108311
x3: 0.480222
x4: 0.387449
x5: 0.357594
x6: 0.047044", "Arm 10_0
hartmann6: -0.776245 (SEM: 0)
x1: 0.737759
x2: 0.00708171
x3: 0.786064
x4: 0.306296
x5: 0.190556
x6: 0.803802", "Arm 11_0
hartmann6: -0.0751005 (SEM: 0)
x1: 0.00499463
x2: 0.85038
x3: 0.282013
x4: 0.881654
x5: 0.845222
x6: 0.0740822", "Arm 12_0
hartmann6: -0.939485 (SEM: 0)
x1: 0.666759
x2: 0
x3: 0.609346
x4: 0.263247
x5: 0.142119
x6: 0.680478", "Arm 13_0
hartmann6: -0.886529 (SEM: 0)
x1: 0.41096
x2: 0.240627
x3: 0.582696
x4: 0.235564
x5: 0.0381626
x6: 0.657492", "Arm 14_0
hartmann6: -0.518645 (SEM: 0)
x1: 0.739039
x2: 1.48277e-15
x3: 0.644439
x4: 0.193962
x5: 0.108279
x6: 0.576811", "Arm 15_0
hartmann6: -0.40956 (SEM: 0)
x1: 0.543757
x2: 0
x3: 0.681759
x4: 0.205896
x5: 0.00162548
x6: 0.722285", "Arm 16_0
hartmann6: -1.39718 (SEM: 0)
x1: 0.500097
x2: 0.267751
x3: 0.526442
x4: 0.265153
x5: 0.131498
x6: 0.618959", "Arm 17_0
hartmann6: -1.52328 (SEM: 0)
x1: 0.439871
x2: 0.414979
x3: 0.475938
x4: 0.281682
x5: 0.161137
x6: 0.705005", "Arm 18_0
hartmann6: -0.613431 (SEM: 0)
x1: 0.447995
x2: 0.556936
x3: 0.414816
x4: 0.0344008
x5: 0.172525
x6: 0.750583", "Arm 19_0
hartmann6: -0.614793 (SEM: 0)
x1: 0.448578
x2: 0.670713
x3: 0.234594
x4: 0.317399
x5: 0.144899
x6: 0.576569", "Arm 1_0
hartmann6: -0.00905957 (SEM: 0)
x1: 0.787701
x2: 0.765017
x3: 0.983973
x4: 0.800578
x5: 0.69976
x6: 0.825102", "Arm 20_0
hartmann6: -1.83846 (SEM: 0)
x1: 0.407511
x2: 0.352
x3: 0.556047
x4: 0.306292
x5: 0.182656
x6: 0.761713", "Arm 21_0
hartmann6: -2.04751 (SEM: 0)
x1: 0.363382
x2: 0.256764
x3: 0.648063
x4: 0.334966
x5: 0.206714
x6: 0.817846", "Arm 22_0
hartmann6: -2.02204 (SEM: 0)
x1: 0.330941
x2: 0.187409
x3: 0.414243
x4: 0.36021
x5: 0.226291
x6: 0.84542", "Arm 23_0
hartmann6: -1.25819 (SEM: 0)
x1: 0.34987
x2: 0.246853
x3: 0.513527
x4: 0.421378
x5: 0.188439
x6: 0.920897", "Arm 2_0
hartmann6: -0.0376266 (SEM: 0)
x1: 0.599525
x2: 0.498112
x3: 0.0586652
x4: 0.243652
x5: 0.752892
x6: 0.548049", "Arm 3_0
hartmann6: -0.390073 (SEM: 0)
x1: 0.144057
x2: 0.655855
x3: 0.554914
x4: 0.568398
x5: 0.156581
x6: 0.326143", "Arm 4_0
hartmann6: -0.0908445 (SEM: 0)
x1: 0.0731118
x2: 0.294861
x3: 0.818363
x4: 0.644828
x5: 0.124673
x6: 0.227329", "Arm 5_0
hartmann6: -0.00503049 (SEM: 0)
x1: 0.684294
x2: 0.574683
x3: 0.314609
x4: 0.0422076
x5: 0.965861
x6: 0.894543", "Arm 6_0
hartmann6: -0.03403 (SEM: 0)
x1: 0.999776
x2: 0.184601
x3: 0.642261
x4: 0.970265
x5: 0.518987
x6: 0.72836", "Arm 7_0
hartmann6: -0.315192 (SEM: 0)
x1: 0.259457
x2: 0.965338
x3: 0.146016
x4: 0.342746
x5: 0.423651
x6: 0.395618", "Arm 8_0
hartmann6: -0.223803 (SEM: 0)
x1: 0.318785
x2: 0.398165
x3: 0.737564
x4: 0.0746043
x5: 0.671853
x6: 0.302765", "Arm 9_0
hartmann6: -0.0253786 (SEM: 0)
x1: 0.921897
x2: 0.740425
x3: 0.241616
x4: 0.737369
x5: 0.263042
x6: 0.573013" ], "type": "scatter", "x": [ 0.4540459215641022, 0.7377590881660581, 0.004994632676243782, 0.666758729350728, 0.41096009008537804, 0.7390386906926667, 0.5437566721939686, 0.5000967255291253, 0.4398711592280446, 0.4479953627357021, 0.4485781356961192, 0.7877011969685555, 0.4075112381562856, 0.3633820276811826, 0.3309406515567845, 0.34987031354732095, 0.5995250539854169, 0.14405696280300617, 0.07311184331774712, 0.6842941446229815, 0.9997762944549322, 0.259456948377192, 0.3187849810346961, 0.921897403895855 ], "xaxis": "x", "y": [ 0.1083107516169548, 0.00708171259611845, 0.8503798572346568, 0.0, 0.24062725975140511, 1.4827693682582122e-15, 0.0, 0.26775140552822324, 0.4149794642859692, 0.5569355970032126, 0.6707134275175982, 0.7650168547406793, 0.35199981901932564, 0.2567641575709474, 0.18740872044416662, 0.24685325432319488, 0.4981119902804494, 0.6558552728965878, 0.29486096929758787, 0.5746827004477382, 0.18460123147815466, 0.965337953530252, 0.39816474821418524, 0.7404247587546706 ], "yaxis": "y" }, { "hoverinfo": "text", "legendgroup": "In-sample", "marker": { "color": "black", "opacity": 0.5, "symbol": 1 }, "mode": "markers", "name": "In-sample", "showlegend": false, "text": [ "Arm 0_0
hartmann6: -0.132631 (SEM: 0)
x1: 0.454046
x2: 0.108311
x3: 0.480222
x4: 0.387449
x5: 0.357594
x6: 0.047044", "Arm 10_0
hartmann6: -0.776245 (SEM: 0)
x1: 0.737759
x2: 0.00708171
x3: 0.786064
x4: 0.306296
x5: 0.190556
x6: 0.803802", "Arm 11_0
hartmann6: -0.0751005 (SEM: 0)
x1: 0.00499463
x2: 0.85038
x3: 0.282013
x4: 0.881654
x5: 0.845222
x6: 0.0740822", "Arm 12_0
hartmann6: -0.939485 (SEM: 0)
x1: 0.666759
x2: 0
x3: 0.609346
x4: 0.263247
x5: 0.142119
x6: 0.680478", "Arm 13_0
hartmann6: -0.886529 (SEM: 0)
x1: 0.41096
x2: 0.240627
x3: 0.582696
x4: 0.235564
x5: 0.0381626
x6: 0.657492", "Arm 14_0
hartmann6: -0.518645 (SEM: 0)
x1: 0.739039
x2: 1.48277e-15
x3: 0.644439
x4: 0.193962
x5: 0.108279
x6: 0.576811", "Arm 15_0
hartmann6: -0.40956 (SEM: 0)
x1: 0.543757
x2: 0
x3: 0.681759
x4: 0.205896
x5: 0.00162548
x6: 0.722285", "Arm 16_0
hartmann6: -1.39718 (SEM: 0)
x1: 0.500097
x2: 0.267751
x3: 0.526442
x4: 0.265153
x5: 0.131498
x6: 0.618959", "Arm 17_0
hartmann6: -1.52328 (SEM: 0)
x1: 0.439871
x2: 0.414979
x3: 0.475938
x4: 0.281682
x5: 0.161137
x6: 0.705005", "Arm 18_0
hartmann6: -0.613431 (SEM: 0)
x1: 0.447995
x2: 0.556936
x3: 0.414816
x4: 0.0344008
x5: 0.172525
x6: 0.750583", "Arm 19_0
hartmann6: -0.614793 (SEM: 0)
x1: 0.448578
x2: 0.670713
x3: 0.234594
x4: 0.317399
x5: 0.144899
x6: 0.576569", "Arm 1_0
hartmann6: -0.00905957 (SEM: 0)
x1: 0.787701
x2: 0.765017
x3: 0.983973
x4: 0.800578
x5: 0.69976
x6: 0.825102", "Arm 20_0
hartmann6: -1.83846 (SEM: 0)
x1: 0.407511
x2: 0.352
x3: 0.556047
x4: 0.306292
x5: 0.182656
x6: 0.761713", "Arm 21_0
hartmann6: -2.04751 (SEM: 0)
x1: 0.363382
x2: 0.256764
x3: 0.648063
x4: 0.334966
x5: 0.206714
x6: 0.817846", "Arm 22_0
hartmann6: -2.02204 (SEM: 0)
x1: 0.330941
x2: 0.187409
x3: 0.414243
x4: 0.36021
x5: 0.226291
x6: 0.84542", "Arm 23_0
hartmann6: -1.25819 (SEM: 0)
x1: 0.34987
x2: 0.246853
x3: 0.513527
x4: 0.421378
x5: 0.188439
x6: 0.920897", "Arm 2_0
hartmann6: -0.0376266 (SEM: 0)
x1: 0.599525
x2: 0.498112
x3: 0.0586652
x4: 0.243652
x5: 0.752892
x6: 0.548049", "Arm 3_0
hartmann6: -0.390073 (SEM: 0)
x1: 0.144057
x2: 0.655855
x3: 0.554914
x4: 0.568398
x5: 0.156581
x6: 0.326143", "Arm 4_0
hartmann6: -0.0908445 (SEM: 0)
x1: 0.0731118
x2: 0.294861
x3: 0.818363
x4: 0.644828
x5: 0.124673
x6: 0.227329", "Arm 5_0
hartmann6: -0.00503049 (SEM: 0)
x1: 0.684294
x2: 0.574683
x3: 0.314609
x4: 0.0422076
x5: 0.965861
x6: 0.894543", "Arm 6_0
hartmann6: -0.03403 (SEM: 0)
x1: 0.999776
x2: 0.184601
x3: 0.642261
x4: 0.970265
x5: 0.518987
x6: 0.72836", "Arm 7_0
hartmann6: -0.315192 (SEM: 0)
x1: 0.259457
x2: 0.965338
x3: 0.146016
x4: 0.342746
x5: 0.423651
x6: 0.395618", "Arm 8_0
hartmann6: -0.223803 (SEM: 0)
x1: 0.318785
x2: 0.398165
x3: 0.737564
x4: 0.0746043
x5: 0.671853
x6: 0.302765", "Arm 9_0
hartmann6: -0.0253786 (SEM: 0)
x1: 0.921897
x2: 0.740425
x3: 0.241616
x4: 0.737369
x5: 0.263042
x6: 0.573013" ], "type": "scatter", "x": [ 0.4540459215641022, 0.7377590881660581, 0.004994632676243782, 0.666758729350728, 0.41096009008537804, 0.7390386906926667, 0.5437566721939686, 0.5000967255291253, 0.4398711592280446, 0.4479953627357021, 0.4485781356961192, 0.7877011969685555, 0.4075112381562856, 0.3633820276811826, 0.3309406515567845, 0.34987031354732095, 0.5995250539854169, 0.14405696280300617, 0.07311184331774712, 0.6842941446229815, 0.9997762944549322, 0.259456948377192, 0.3187849810346961, 0.921897403895855 ], "xaxis": "x2", "y": [ 0.1083107516169548, 0.00708171259611845, 0.8503798572346568, 0.0, 0.24062725975140511, 1.4827693682582122e-15, 0.0, 0.26775140552822324, 0.4149794642859692, 0.5569355970032126, 0.6707134275175982, 0.7650168547406793, 0.35199981901932564, 0.2567641575709474, 0.18740872044416662, 0.24685325432319488, 0.4981119902804494, 0.6558552728965878, 0.29486096929758787, 0.5746827004477382, 0.18460123147815466, 0.965337953530252, 0.39816474821418524, 0.7404247587546706 ], "yaxis": "y2" } ], "layout": { "annotations": [ { "font": { "size": 14 }, "showarrow": false, "text": "Mean", "x": 0.25, "xanchor": "center", "xref": "paper", "y": 1, "yanchor": "bottom", "yref": "paper" }, { "font": { "size": 14 }, "showarrow": false, "text": "Standard Error", "x": 0.8, "xanchor": "center", "xref": "paper", "y": 1, "yanchor": "bottom", "yref": "paper" } ], "autosize": false, "height": 450, "hovermode": "closest", "legend": { "orientation": "h", "x": 0, "y": -0.25 }, "margin": { "b": 100, "l": 35, "pad": 0, "r": 35, "t": 35 }, "template": { "data": { "bar": [ { "error_x": { "color": "#2a3f5f" }, "error_y": { "color": "#2a3f5f" }, "marker": { "line": { "color": "#E5ECF6", "width": 0.5 }, "pattern": { "fillmode": "overlay", "size": 10, "solidity": 0.2 } }, "type": "bar" } ], "barpolar": [ { "marker": { "line": { "color": "#E5ECF6", "width": 0.5 }, "pattern": { "fillmode": "overlay", "size": 10, "solidity": 0.2 } }, "type": "barpolar" } ], "carpet": [ { "aaxis": { "endlinecolor": "#2a3f5f", "gridcolor": "white", "linecolor": "white", "minorgridcolor": "white", "startlinecolor": "#2a3f5f" }, "baxis": { "endlinecolor": "#2a3f5f", "gridcolor": "white", "linecolor": "white", "minorgridcolor": "white", "startlinecolor": "#2a3f5f" }, "type": "carpet" } ], "choropleth": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "type": "choropleth" } ], "contour": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "contour" } ], "contourcarpet": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "type": "contourcarpet" } ], "heatmap": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "heatmap" } ], "heatmapgl": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "heatmapgl" } ], "histogram": [ { "marker": { "pattern": { "fillmode": "overlay", "size": 10, "solidity": 0.2 } }, "type": "histogram" } ], "histogram2d": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "histogram2d" } ], "histogram2dcontour": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "histogram2dcontour" } ], "mesh3d": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "type": "mesh3d" } ], "parcoords": [ { "line": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "parcoords" } ], "pie": [ { "automargin": true, "type": "pie" } ], "scatter": [ { "fillpattern": { "fillmode": "overlay", "size": 10, "solidity": 0.2 }, "type": "scatter" } ], "scatter3d": [ { "line": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scatter3d" } ], "scattercarpet": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scattercarpet" } ], "scattergeo": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scattergeo" } ], "scattergl": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scattergl" } ], "scattermapbox": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scattermapbox" } ], "scatterpolar": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scatterpolar" } ], "scatterpolargl": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scatterpolargl" } ], "scatterternary": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scatterternary" } ], "surface": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "surface" } ], "table": [ { "cells": { "fill": { "color": "#EBF0F8" }, "line": { "color": "white" } }, "header": { "fill": { "color": "#C8D4E3" }, "line": { "color": "white" } }, "type": "table" } ] }, "layout": { "annotationdefaults": { "arrowcolor": "#2a3f5f", "arrowhead": 0, "arrowwidth": 1 }, "autotypenumbers": "strict", "coloraxis": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "colorscale": { "diverging": [ [ 0, "#8e0152" ], [ 0.1, "#c51b7d" ], [ 0.2, "#de77ae" ], [ 0.3, "#f1b6da" ], [ 0.4, "#fde0ef" ], [ 0.5, "#f7f7f7" ], [ 0.6, "#e6f5d0" ], [ 0.7, "#b8e186" ], [ 0.8, "#7fbc41" ], [ 0.9, "#4d9221" ], [ 1, "#276419" ] ], "sequential": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "sequentialminus": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ] }, "colorway": [ "#636efa", "#EF553B", "#00cc96", "#ab63fa", "#FFA15A", "#19d3f3", "#FF6692", "#B6E880", "#FF97FF", "#FECB52" ], "font": { "color": "#2a3f5f" }, "geo": { "bgcolor": "white", "lakecolor": "white", "landcolor": "#E5ECF6", "showlakes": true, "showland": true, "subunitcolor": "white" }, "hoverlabel": { "align": "left" }, "hovermode": "closest", "mapbox": { "style": "light" }, "paper_bgcolor": "white", "plot_bgcolor": "#E5ECF6", "polar": { "angularaxis": { "gridcolor": "white", "linecolor": "white", "ticks": "" }, "bgcolor": "#E5ECF6", "radialaxis": { "gridcolor": "white", "linecolor": "white", "ticks": "" } }, "scene": { "xaxis": { "backgroundcolor": "#E5ECF6", "gridcolor": "white", "gridwidth": 2, "linecolor": "white", "showbackground": true, "ticks": "", "zerolinecolor": "white" }, "yaxis": { "backgroundcolor": "#E5ECF6", "gridcolor": "white", "gridwidth": 2, "linecolor": "white", "showbackground": true, "ticks": "", "zerolinecolor": "white" }, "zaxis": { "backgroundcolor": "#E5ECF6", "gridcolor": "white", "gridwidth": 2, "linecolor": "white", "showbackground": true, "ticks": "", "zerolinecolor": "white" } }, "shapedefaults": { "line": { "color": "#2a3f5f" } }, "ternary": { "aaxis": { "gridcolor": "white", "linecolor": "white", "ticks": "" }, "baxis": { "gridcolor": "white", "linecolor": "white", "ticks": "" }, "bgcolor": "#E5ECF6", "caxis": { "gridcolor": "white", "linecolor": "white", "ticks": "" } }, "title": { "x": 0.05 }, "xaxis": { "automargin": true, "gridcolor": "white", "linecolor": "white", "ticks": "", "title": { "standoff": 15 }, "zerolinecolor": "white", "zerolinewidth": 2 }, "yaxis": { "automargin": true, "gridcolor": "white", "linecolor": "white", "ticks": "", "title": { "standoff": 15 }, "zerolinecolor": "white", "zerolinewidth": 2 } } }, "title": { "text": "hartmann6" }, "width": 950, "xaxis": { "anchor": "y", "autorange": false, "domain": [ 0.05, 0.45 ], "exponentformat": "e", "range": [ 0.0, 1.0 ], "tickfont": { "size": 11 }, "tickmode": "auto", "title": { "text": "x1" }, "type": "linear" }, "xaxis2": { "anchor": "y2", "autorange": false, "domain": [ 0.6, 1 ], "exponentformat": "e", "range": [ 0.0, 1.0 ], "tickfont": { "size": 11 }, "tickmode": "auto", "title": { "text": "x1" }, "type": "linear" }, "yaxis": { "anchor": "x", "autorange": false, "domain": [ 0, 1 ], "exponentformat": "e", "range": [ 0.0, 1.0 ], "tickfont": { "size": 11 }, "tickmode": "auto", "title": { "text": "x2" }, "type": "linear" }, "yaxis2": { "anchor": "x2", "autorange": false, "domain": [ 0, 1 ], "exponentformat": "e", "range": [ 0.0, 1.0 ], "tickfont": { "size": 11 }, "tickmode": "auto", "type": "linear" } } }, "text/html": [ "
" ] }, "metadata": {}, "output_type": "display_data" } ], "source": [ "render(ax_client.get_contour_plot())" ] }, { "cell_type": "markdown", "id": "a83e110b", "metadata": { "papermill": { "duration": 0.061889, "end_time": "2024-09-23T20:26:33.019722", "exception": false, "start_time": "2024-09-23T20:26:32.957833", "status": "completed" }, "tags": [] }, "source": [ "We can also retrieve a contour plot for the other metric, \"l2norm\" –– say, we are interested in seeing the response surface for parameters \"x3\" and \"x4\" for this one." ] }, { "cell_type": "code", "execution_count": 12, "id": "7fc95abb", "metadata": { "execution": { "iopub.execute_input": "2024-09-23T20:26:33.145622Z", "iopub.status.busy": "2024-09-23T20:26:33.145095Z", "iopub.status.idle": "2024-09-23T20:26:33.691117Z", "shell.execute_reply": "2024-09-23T20:26:33.690380Z" }, "papermill": { "duration": 0.614256, "end_time": "2024-09-23T20:26:33.696114", "exception": false, "start_time": "2024-09-23T20:26:33.081858", "status": "completed" }, "tags": [] }, "outputs": [ { "name": "stderr", "output_type": "stream", "text": [ "[INFO 09-23 20:26:33] ax.service.ax_client: Retrieving contour plot with parameter 'x3' on X-axis and 'x4' on Y-axis, for metric 'l2norm'. Remaining parameters are affixed to the middle of their range.\n" ] }, { "data": { "application/vnd.plotly.v1+json": { "config": { "linkText": "Export to plot.ly", "plotlyServerURL": "https://plot.ly", "showLink": false }, "data": [ { "autocolorscale": false, "autocontour": true, "colorbar": { "tickfont": { "size": 8 }, "ticksuffix": "", "x": 0.45, "y": 0.5 }, "colorscale": [ [ 0.0, "rgb(247,252,253)" ], [ 0.125, "rgb(229,245,249)" ], [ 0.25, "rgb(204,236,230)" ], [ 0.375, "rgb(153,216,201)" ], [ 0.5, "rgb(102,194,164)" ], [ 0.625, "rgb(65,174,118)" ], [ 0.75, "rgb(35,139,69)" ], [ 0.875, "rgb(0,109,44)" ], [ 1.0, "rgb(0,68,27)" ] ], "contours": { "coloring": "heatmap" }, "hoverinfo": "x+y+z", "ncontours": 25, "type": "contour", "x": [ 0.0, 0.02040816326530612, 0.04081632653061224, 0.061224489795918366, 0.08163265306122448, 0.1020408163265306, 0.12244897959183673, 0.14285714285714285, 0.16326530612244897, 0.18367346938775508, 0.2040816326530612, 0.22448979591836732, 0.24489795918367346, 0.26530612244897955, 0.2857142857142857, 0.3061224489795918, 0.32653061224489793, 0.3469387755102041, 0.36734693877551017, 0.3877551020408163, 0.4081632653061224, 0.42857142857142855, 0.44897959183673464, 0.4693877551020408, 0.4897959183673469, 0.5102040816326531, 0.5306122448979591, 0.5510204081632653, 0.5714285714285714, 0.5918367346938775, 0.6122448979591836, 0.6326530612244897, 0.6530612244897959, 0.673469387755102, 0.6938775510204082, 0.7142857142857142, 0.7346938775510203, 0.7551020408163265, 0.7755102040816326, 0.7959183673469387, 0.8163265306122448, 0.836734693877551, 0.8571428571428571, 0.8775510204081632, 0.8979591836734693, 0.9183673469387754, 0.9387755102040816, 0.9591836734693877, 0.9795918367346939, 1.0 ], "xaxis": "x", "y": [ 0.0, 0.02040816326530612, 0.04081632653061224, 0.061224489795918366, 0.08163265306122448, 0.1020408163265306, 0.12244897959183673, 0.14285714285714285, 0.16326530612244897, 0.18367346938775508, 0.2040816326530612, 0.22448979591836732, 0.24489795918367346, 0.26530612244897955, 0.2857142857142857, 0.3061224489795918, 0.32653061224489793, 0.3469387755102041, 0.36734693877551017, 0.3877551020408163, 0.4081632653061224, 0.42857142857142855, 0.44897959183673464, 0.4693877551020408, 0.4897959183673469, 0.5102040816326531, 0.5306122448979591, 0.5510204081632653, 0.5714285714285714, 0.5918367346938775, 0.6122448979591836, 0.6326530612244897, 0.6530612244897959, 0.673469387755102, 0.6938775510204082, 0.7142857142857142, 0.7346938775510203, 0.7551020408163265, 0.7755102040816326, 0.7959183673469387, 0.8163265306122448, 0.836734693877551, 0.8571428571428571, 0.8775510204081632, 0.8979591836734693, 0.9183673469387754, 0.9387755102040816, 0.9591836734693877, 0.9795918367346939, 1.0 ], "yaxis": "y", "z": [ [ 0.9616669397833482, 0.9615817365732535, 0.9618704504217712, 0.9625343213895284, 0.9635740858889743, 0.964989972454037, 0.966781698593911, 0.9689484687466596, 0.9714889733449481, 0.9744013890031423, 0.9776833798315516, 0.9813320998803714, 0.9853441967124243, 0.9897158161003972, 0.994442607840984, 0.9995197326747363, 1.0049418702973196, 1.0107032284442967, 1.0167975530284445, 1.0232181393052495, 1.0299578440392025, 1.0370090986403067, 1.0443639232373663, 1.0520139416516467, 1.0599503972318076, 1.0681641695084323, 1.076645791623888, 1.0853854684910569, 1.0943730956322173, 1.1035982786473792, 1.1130503532596037, 1.1227184058831428, 1.1325912946587697, 1.1426576708994676, 1.1529060008885648, 1.1633245879715042, 1.1739015948818248, 1.1846250662414939, 1.1954829511753846, 1.2064631259798722, 1.2175534167854107, 1.2287416221535923, 1.2400155355496114, 1.2513629676318918, 1.2627717683015995, 1.2742298484559618, 1.2857252013905998, 1.2972459237976366, 1.308780236308153, 1.3203165035291513 ], [ 0.9596309103045797, 0.9595558007911512, 0.9598556247870547, 0.9605316110439799, 0.9615844831953837, 0.9630144555464191, 0.9648212299513916, 0.9670039937944218, 0.9695614190855355, 0.9724916626813658, 0.9757923676361924, 0.9794606656856999, 0.9834931808625395, 0.9878860342392508, 0.9926348497907939, 0.9977347613654455, 1.0031804207495036, 1.0089660068079302, 1.0150852356796238, 1.021531372002932, 1.0282972411437694, 1.035375242395675, 1.0427573631180747, 1.0504351937762761, 1.0583999438438545, 1.0666424585255652, 1.0751532362563263, 1.0839224469296265, 1.092939950806428, 1.1021953180537158, 1.1116778488599568, 1.12137659407313, 1.1312803763055912, 1.1413778114486328, 1.1516573305386744, 1.1621072019161207, 1.1727155536172902, 1.1834703959392674, 1.1943596441175006, 1.2053711410557346, 1.2164926800481541, 1.2277120274340307, 1.239016945125593, 1.25039521295086, 1.2618346507539548, 1.2733231401966987, 1.284848646206636, 1.2963992380181693, 1.30796310975511, 1.3195286005050477 ], [ 0.9580996774117134, 0.9580360020937266, 0.9583480533400888, 0.9590370465111924, 0.9601036906626433, 0.961548184360267, 0.9633702125855362, 0.9655689447469208, 0.9681430338094159, 0.9710906165512954, 0.9744093149536887, 0.9780962387253752, 0.9821479889616416, 0.9865606629327461, 0.9913298599940599, 0.9964506886065133, 1.0019177744527301, 1.0077252696306815, 1.013866862903567, 1.0203357909813036, 1.0271248508058164, 1.034226412809301, 1.0416324351116535, 1.0493344786202998, 1.0573237229929817, 1.0655909834214452, 1.074126728191426, 1.082921096972084, 1.0919639197858018, 1.1012447366073026, 1.1107528175392316, 1.1204771835096548, 1.1304066274355558, 1.1405297357950852, 1.1508349105502935, 1.1613103913612792, 1.1719442780319083, 1.1827245531269779, 1.1936391047003234, 1.2046757490734756, 1.2158222536045609, 1.2270663593875901, 1.2383958038228238, 1.2497983429997859, 1.261261773835384, 1.2727739559108562, 1.284322832952604, 1.2958964539035158, 1.307482993533082, 1.3190707725366002 ], [ 0.9570796959324197, 0.9570288185385979, 0.9573542348407198, 0.9580571447003764, 0.9591382407743263, 0.9605977043594902, 0.9624352023306367, 0.964649885186126, 0.9672403862139951, 0.9702048217871393, 0.9735407927933235, 0.9772453872021187, 0.9813151837675882, 0.9857462568621458, 0.9905341824334882, 0.9956740450731625, 1.0011604461819152, 1.0069875132136614, 1.0131489099765025, 1.0196378479660886, 1.026447098703387, 1.033569007045846, 1.0409955054380045, 1.0487181290646064, 1.0567280318666994, 1.0650160033784133, 1.0735724863397258, 1.0823875950381658, 1.0914511343303102, 1.1007526192917567, 1.1102812954426597, 1.1200261594941656, 1.1299759805595626, 1.1401193217729229, 1.1504445622567474, 1.1609399193794254, 1.1715934712426035, 1.182393179338152, 1.193326911314212, 1.2043824637897445, 1.2155475851572521, 1.2268099983136858, 1.2381574232602217, 1.2495775995123106, 1.2610583082625142, 1.2725873942396997, 1.2841527872096927, 1.2957425230638797, 1.3073447644441367, 1.3189478208542456 ], [ 0.9565765789762283, 0.9565398834779587, 0.9568798207169207, 0.9575975729274859, 0.9586938145282362, 0.960168708001906, 0.9620219008696296, 0.9642525237748971, 0.9668591896891509, 0.9698399942480271, 0.9731925172235031, 0.9769138251341966, 0.9810004749923913, 0.9854485191831276, 0.9902535114671063, 0.9954105140958643, 1.0009141060242452, 1.0067583922018115, 1.0129370139215559, 1.0194431602010119, 1.0262695801677415, 1.0334085964180193, 1.0408521193145999, 1.0485916621865654, 1.056618357391492, 1.0649229731976146, 1.0734959314410497, 1.0823273259110024, 1.091406941413581, 1.1007242734628946, 1.1102685485463037, 1.1200287449090849, 1.12999361380226, 1.140151701136177, 1.150491369481335, 1.161000820357143, 1.1716681167485739, 1.182481205790478, 1.1934279415587592, 1.2044961079079293, 1.2156734412946244, 1.2269476535269899, 1.238306454380641, 1.2497375740225678, 1.261228785185414, 1.2727679250357644, 1.2843429166814897, 1.2959417902646337, 1.3075527035882883, 1.319163962227515 ], [ 0.9565950763746449, 0.956573963875615, 0.9569295932666312, 0.9576631270098468, 0.9587752194319387, 0.9602660126439042, 0.9621351335563013, 0.9643816920050547, 0.9670042799998186, 0.9700009721036342, 0.9733693269491135, 0.9771063898932535, 0.9812086968093146, 0.9856722790109502, 0.9904926693002791, 0.9956649091281644, 1.00118355685162, 1.0070426970698223, 1.013235951017012, 1.019756487987224, 1.0265970377626765, 1.0337499040145413, 1.041206978641838, 1.0489597570113347, 1.0569993540585962, 1.0653165212076776, 1.0739016640644843, 1.0827448608365873, 1.091835881429988, 1.1011642071714662, 1.1107190511032665, 1.1204893787952512, 1.1304639296182648, 1.1406312384212154, 1.1509796575532114, 1.16149737917151, 1.1721724577751234, 1.1829928329037416, 1.1939463519413247, 1.2050207929636239, 1.2162038875693484, 1.2274833436348302, 1.2388468679328861, 1.2502821885572313, 1.2617770770949168, 1.273319370490454, 1.2848969925466012, 1.296497975008521, 1.3081104781795598, 1.3197228110190007 ], [ 0.9571390553022547, 0.9571349408135369, 0.957507446056638, 0.9582577115644672, 0.9593863697076582, 0.9608935406592614, 0.962778829455282, 0.9650413241661601, 0.9676795951909901, 0.9706916956830759, 0.9740751631120124, 0.977827021964137, 0.9819437875797867, 0.9864214711222898, 0.991255585670378, 0.9964411534220092, 1.001972713994522, 1.0078443338024263, 1.0140496164909274, 1.0205817144000866, 1.027433341031317, 1.034596784484736, 1.0420639218331214, 1.0498262343951945, 1.057874823868205, 1.0662004292773681, 1.0747934446969223, 1.0836439376956264, 1.0927416684570692, 1.1020761095233365, 1.1116364661087497, 1.1214116969287518, 1.131390535487643, 1.1415615117675306, 1.1519129742599976, 1.1624331122809957, 1.1731099785089556, 1.1839315116856821, 1.194885559419379, 1.2059599010291615, 1.2171422703706414, 1.2284203785826042, 1.239781936695405, 1.2512146780425133, 1.2627063804177474, 1.2742448879218664, 1.2858181324435982, 1.2974141547218585, 1.3090211249374808, 1.3206273627849054 ], [ 0.9582114831657582, 0.9582257922753594, 0.9586163666065861, 0.959384322598595, 0.9605302687956158, 0.9620543018614691, 0.9639560036898447, 0.9662344396251662, 0.9688881578058168, 0.9719151896380622, 0.9753130514058668, 0.9790787470181405, 0.9832087718918494, 0.9876991179657133, 0.9925452798360486, 0.9977422620026666, 1.0032845872095135, 1.0091663058613423, 1.0153810064943518, 1.0219218272755581, 1.028781468502499, 1.0359522060717334, 1.0434259058817268, 1.0511940391327348, 1.0592476984837131, 1.0675776150235008, 1.0761741760112251, 1.0850274433384803, 1.0941271726636803, 1.1034628331671459, 1.1130236278734595, 1.1227985144862793, 1.132776226679158, 1.1429452957848818, 1.1532940728246308, 1.1638107508176563, 1.174483387311381, 1.1852999270715208, 1.1962482248716448, 1.2073160683215172, 1.2184912006739352, 1.229761343550028, 1.241114219523813, 1.252537574507461, 1.2640191998798902, 1.2755469543024567, 1.2871087851669527, 1.2986927496226353, 1.3102870351309317, 1.3218799794981342 ], [ 0.9598144128401018, 0.9598485782866618, 0.9602584214383298, 0.9610450324732926, 0.9622089942369643, 0.963750378311387, 0.9656687421795669, 0.9679631274995416, 0.9706320594996649, 0.973673547503445, 0.9770850865888339, 0.980863660383476, 0.9850057449941223, 0.9895073140648427, 0.9943638449554364, 0.9995703260278144, 1.0051212650249335, 1.0110106985234375, 1.0172322024378173, 1.0237789035508027, 1.0306434920413658, 1.0378182349788696, 1.045294990748717, 1.0530652243721446, 1.0611200236800356, 1.0694501162980221, 1.0780458873977157, 1.0868973981665797, 1.0959944049468902, 1.1053263789921761, 1.114882526787829, 1.1246518108809467, 1.1346229711630396, 1.1447845465480562, 1.155124896987173, 1.1656322257609633, 1.1762946019889458, 1.1870999832962235, 1.1980362385765726, 1.2090911707915402, 1.220252539745212, 1.2315080847748405, 1.2428455472981066, 1.2542526931586702, 1.2657173347127053, 1.2772273526002829, 1.2887707171469807, 1.3003355093426128, 1.3119099413457256, 1.323482376464526 ], [ 0.9619489703229356, 0.9620044284836231, 0.9624347435628768, 0.9632409773126882, 0.9644236850095445, 0.9659829115836598, 0.9679181888417644, 0.9702285337980562, 0.972912448124724, 0.9759679187300976, 0.9793924194692549, 0.9831829139883723, 0.9873358597009232, 0.9918472128902055, 0.9967124349293783, 1.0019264996068138, 1.007483901541047, 1.0133786656664754, 1.0196043577674812, 1.0261540960355133, 1.0330205636206204, 1.0401960221456221, 1.0476723261484011, 1.05544093841485, 1.063492946162228, 1.0718190780302663, 1.0804097218347217, 1.0892549430359906, 1.0983445038730975, 1.107667883111575, 1.1172142963518463, 1.1269727168432362, 1.1369318967473139, 1.1470803887930041, 1.1574065682650045, 1.1678986552662085, 1.1785447371942017, 1.1893327913716034, 1.2002507077697784, 1.2112863117655184, 1.2224273868705111, 1.2336616973739192, 1.244977010838962, 1.2563611203952816, 1.2678018667699735, 1.2792871600013174, 1.2908050007806642, 1.3023435013696272, 1.3138909060413815, 1.3254356109968648 ], [ 0.9646153448700329, 0.9646935321733601, 0.9651455224685191, 0.9659723469229791, 0.9671745313808403, 0.9687520925568494, 0.9707045353219517, 0.973030851094911, 0.9757295173510866, 0.9787984982563879, 0.9822352464309216, 0.9860367058436219, 0.9901993158356327, 0.9947190162669065, 0.9995912537770404, 1.0048109891479038, 1.0103727057524265, 1.016270419070386, 1.022497687248873, 1.0290476226818994, 1.0359129045804445, 1.0430857925011745, 1.050558140799231, 1.0583214139675068, 1.066366702822247, 1.0746847414921872, 1.0832659251660037, 1.092100328550603, 1.1011777249907033, 1.110487606198111, 1.1200192025374762, 1.1297615038136268, 1.1397032805042513, 1.149833105380522, 1.160139375457177, 1.1706103342129752, 1.181234094021598, 1.191998658732982, 1.2028919463446708, 1.2139018117030098, 1.2250160691740621, 1.2362225152248074, 1.2475089508556332, 1.2588632038261303, 1.270273150617196, 1.2817267380737278, 1.293212004673537, 1.304717101369801, 1.3162303119561445, 1.327740072905266 ], [ 0.9678127816655924, 0.9679151309401437, 0.968389996664927, 0.9692383772763576, 0.9704607673337757, 0.9720571537831317, 0.9740270133096631, 0.9763693107937923, 0.9790824988813125, 0.9821645186754532, 0.9856128015554291, 0.9894242721223308, 0.993595352270197, 0.9981219663764125, 1.0029995476023552, 1.008223045291816, 1.01378693345125, 1.0196852202927429, 1.025911458817251, 1.032458758412404, 1.0393197974362054, 1.0464868367547693, 1.0539517341994062, 1.0617059599055085, 1.0697406124930153, 1.0780464360456747, 1.086613837843937, 1.0954329068039357, 1.1044934325731488, 1.1137849252311331, 1.123296635542238, 1.1330175757054062, 1.1429365405450238, 1.1530421290854083, 1.1633227664507166, 1.173766726031138, 1.1843621518557927, 1.1950970811123094, 1.2059594667529494, 1.216937200127196, 1.2280181335809701, 1.239190102963128, 1.2504409499805291, 1.2617585443438828, 1.2731308056475765, 1.2845457249279968, 1.2959913858462158, 1.307455985442649, 1.3189278544128578, 1.3303954768558437 ], [ 0.9715395770721991, 0.9716675138427431, 0.972166448828748, 0.9730373456057841, 0.9742806656115959, 0.9758963644843148, 0.9778838894865236, 0.9802421780291498, 0.9829696573059424, 0.9860642450461783, 0.9895233513897091, 0.9933438818852636, 0.9975222416095619, 1.002054340401223, 1.0069355992003648, 1.0121609574810753, 1.01772488176094, 1.0236213751682133, 1.0298439880441799, 1.036385829554948, 1.0432395802838788, 1.0503975057727863, 1.0578514709772044, 1.0655929555981143, 1.0736130702499431, 1.0819025734220877, 1.090451889188734, 1.0992511256196544, 1.1082900938424403, 1.1175583277047916, 1.12704510398379, 1.1367394630874157, 1.1466302301923244, 1.1567060367607418, 1.1669553423782506, 1.177366456853656, 1.1879275625213706, 1.198626736686638, 1.209451974153572, 1.2203912097761538, 1.2314323409725707, 1.2425632501438406, 1.2537718269381453, 1.265045990303432, 1.2763737102716612, 1.2877430294195353, 1.2991420839518057, 1.3105591243550077, 1.3219825355711643, 1.3334008566429616 ], [ 0.9757930764958187, 0.975948015238639, 0.9764722035868312, 0.9773665681470494, 0.9786315354186108, 0.980267028211113, 0.9822724631440706, 0.9846467492423616, 0.9873882876380704, 0.9904949723860718, 0.993964192397309, 0.9977928344905438, 1.0019772875598363, 1.0065134478517526, 1.0113967253428275, 1.0166220512045911, 1.0221838863399784, 1.0280762309717837, 1.0342926352605448, 1.0408262109260413, 1.0476696438435764, 1.0548152075831312, 1.0622547778566498, 1.069979847835898, 1.077981544300712, 1.086250644574872, 1.0947775942045082, 1.103552525331731, 1.1125652757140734, 1.1218054083384303, 1.1312622315765788, 1.140924819827665, 1.1507820345918334, 1.1608225459179984, 1.1710348541677795, 1.1814073120368573, 1.1919281467746095, 1.2025854825423627, 1.213367362850552, 1.2242617730152352, 1.2352566625745345, 1.2463399676061844, 1.2574996328880053, 1.2687236338439993, 1.279999998219867, 1.2913168274329403, 1.302662317543054, 1.3140247797924411, 1.325392660664462, 1.3367545614130647 ], [ 0.9805696748916047, 0.9807530152611788, 0.9813036279634519, 0.9822224005547696, 0.9835097228037664, 0.9851654831930671, 0.9871890664986955, 0.9895793524606369, 0.9923347155549331, 0.9954530258744252, 0.9989316511219606, 1.002767459716509, 1.0069568250094272, 1.0114956306045673, 1.0163792767726827, 1.0216026879473068, 1.0271603212857727, 1.0330461762759942, 1.0392538053662514, 1.0457763255921426, 1.0526064311718524, 1.059736407037722, 1.06715814326951, 1.0748631503916446, 1.0828425754944564, 1.0910872191365883, 1.0995875529836403, 1.1083337381357674, 1.1173156440949512, 1.1265228683208217, 1.1359447563221376, 1.145570422229607, 1.1553887697943053, 1.1653885137549704, 1.17555820151632, 1.185886235079996, 1.1963608931691212, 1.2069703534871101, 1.2177027150513546, 1.2285460205423713, 1.2394882786094144, 1.250517486073966, 1.261621649973219, 1.2727888093865964, 1.2840070569894328, 1.295264560279098, 1.3065495824204842, 1.3178505026591658, 1.3291558362525313, 1.3404542538709607 ], [ 0.985864819926495, 0.9860779429658881, 0.9866561345080074, 0.987600241009172, 0.9889106137440745, 0.990587105396269, 0.9926290677214029, 0.9950353502963742, 0.9978043003645654, 1.0009337637839688, 1.0044210870819037, 1.0082631206164936, 1.0124562228419631, 1.0169962656713174, 1.0218786409267047, 1.0270982678644627, 1.032649601758455, 1.0385266435221883, 1.0447229503469184, 1.0512316473298289, 1.0580454400633799, 1.0651566281538907, 1.0725571196346273, 1.080238446235858, 1.088191779471803, 1.096407947501862, 1.10487745272115, 1.1135904900333053, 1.1225369657563045, 1.1317065171104117, 1.1410885322354667, 1.1506721706834622, 1.1604463843308452, 1.1703999386539832, 1.1805214343103287, 1.190799328967024, 1.2012219593182412, 1.2117775632322554, 1.2224543019690213, 1.2332402824093516, 1.244123579236852, 1.2550922570144372, 1.2661343920979102, 1.2772380943299502, 1.288391528458966, 1.299582935228559, 1.31080065208476, 1.322033133449823, 1.3332689705131244, 1.3444969104917461 ], [ 0.9916730178046749, 0.9919172821522722, 0.9925241871097161, 0.9934945360202301, 0.994828639934807, 0.9965263142961331, 0.9985868766896183, 1.0010091456745756, 1.0037914407053488, 1.0069315831490628, 1.0104268984033242, 1.0142742191139982, 1.0184698894897954, 1.0230097707071695, 1.027889247395557, 1.0331032351899563, 1.0386461893342291, 1.044512114315632, 1.0506945745076108, 1.0571867057950048, 1.0639812281526477, 1.0710704591454965, 1.078446328315552, 1.0861003924180845, 1.0940238514671534, 1.1022075655479222, 1.1106420723509263, 1.119317605381279, 1.1282241127939294, 1.137351276804025, 1.1466885336200112, 1.156225093845447, 1.1659499632943693, 1.1758519641637835, 1.1859197565061865, 1.1961418599440674, 1.2065066755680631, 1.217002507960006, 1.2276175872820947, 1.2383400913734655, 1.2491581677958412, 1.2600599557703247, 1.2710336079482718, 1.282067311959934, 1.2931493116857078, 1.30426792819622, 1.3154115803086084, 1.326568804708442, 1.3377282755880058, 1.3488788237540272 ], [ 0.9979878417519095, 0.9982645798571972, 0.9989013094956339, 0.9998987889257682, 1.0012572872831138, 1.0029765813619673, 1.0050559534581562, 1.0074941902855696, 1.0102895829759069, 1.013439928168122, 1.0169425301906516, 1.020794204336306, 1.0249912812263968, 1.02952961225739, 1.0344045761200393, 1.039611086377741, 1.0451436000875385, 1.050996127444035, 1.0571622424233733, 1.0636350944012054, 1.0704074207157908, 1.077471560144241, 1.0848194672572857, 1.0924427276151365, 1.1003325737645024, 1.1084799019943197, 1.1168752898056278, 1.1255090140485862, 1.1343710696780192, 1.143451189076715, 1.152738861894329, 1.162223355348163, 1.1718937349308274, 1.181738885468793, 1.191747532474872, 1.2019082637370435, 1.2122095510855626, 1.2226397722799434, 1.2331872329574562, 1.2438401885847556, 1.254586866354711, 1.2654154869709433, 1.2763142862633448, 1.2872715365787688, 1.298275567892088, 1.3093147885842724, 1.3203777058353448, 1.331452945581972, 1.3425292719909785, 1.3535956064021677 ], [ 1.0048019431446917, 1.0051124575060273, 1.0057800963981622, 1.006805571069805, 1.0081891070915772, 1.009930441240054, 1.0120288194361169, 1.0144829957500112, 1.0172912324823924, 1.0204513013275012, 1.0239604856213023, 1.0278155836743283, 1.0320129131855138, 1.036548316730151, 1.0414171683118454, 1.0466143809649364, 1.052134415390858, 1.0579712896085454, 1.0641185895959415, 1.070569480896637, 1.077316721162639, 1.0843526736014248, 1.0916693212926238, 1.0992582823370016, 1.1071108257979665, 1.1152178883932167, 1.1235700918921063, 1.1321577611720224, 1.140970942885183, 1.1499994246854919, 1.1592327549634147, 1.1686602630355192, 1.178271079733899, 1.1880541583398716, 1.1979982958052682, 1.2080921542041365, 1.2183242823571212, 1.2286831375705252, 1.2391571074320424, 1.249734531605281, 1.2604037235654633, 1.2711529922193339, 1.2819706633529144, 1.2928451008518012, 1.303764727639635, 1.3147180462818104, 1.3256936592028394, 1.336680288467477, 1.3476667950774146, 1.358642197737421 ], [ 1.012107065260155, 1.0124526246973515, 1.0131522273680882, 1.014206535637259, 1.0156157299078363, 1.0173795056114627, 1.0194970712460605, 1.0219671474726009, 1.0247879672799538, 1.0279572772237624, 1.0314723397418681, 1.03532993654583, 1.039526373084583, 1.044057484073254, 1.048918640076781, 1.054104755134716, 1.059610295410622, 1.0654292888459607, 1.0715553357956473, 1.0779816206192014, 1.0847009241984524, 1.0917056373500895, 1.0989877750984056, 1.1065389917710364, 1.1143505968779523, 1.1224135717316277, 1.1307185867639502, 1.1392560194935366, 1.1480159730949517, 1.1569882955198283, 1.1661625991180569, 1.1755282807060015, 1.1850745420273474, 1.1947904105511769, 1.2046647605511225, 1.214686334408669, 1.2248437640832937, 1.2351255926919458, 1.2455202961401812, 1.2560163047475654, 1.2666020248101624, 1.2772658600436642, 1.2879962328511785, 1.2987816053609118, 1.3096105001798826, 1.320471520811121, 1.3313533716834154, 1.3422448777440081, 1.353135003566748, 1.3640128719298459 ], [ 1.0198940596125794, 1.020275895587286, 1.0210084831990582, 1.0220924341108775, 1.0235278820062872, 1.0253144796906697, 1.0274513972317192, 1.0299373211509142, 1.0327704546746892, 1.0359485190508164, 1.039468755932446, 1.043327930828924, 1.047522337619415, 1.0520478041220158, 1.0568996987079087, 1.0620729379468548, 1.0675619952672002, 1.073360910610395, 1.0794633010570653, 1.0858623723984988, 1.092550931624677, 1.0995214002970584, 1.10676582877158, 1.1142759112348206, 1.1220430015137044, 1.130058129616753, 1.1383120189628042, 1.1467951042509281, 1.155497549923396, 1.1644092691719066, 1.173519943435609, 1.1828190423380742, 1.1922958440093734, 1.2019394557380065, 1.2117388348971103, 1.2216828100882875, 1.2317601024462796, 1.2419593470473351, 1.2522691143641547, 1.2626779317103871, 1.273174304618099, 1.2837467380921228, 1.294383757685988, 1.3050739303449934, 1.3158058849631917, 1.3265683326022815, 1.3373500863218097, 1.348140080571898, 1.358927390101178, 1.369701248334919 ], [ 1.0281529048325266, 1.0285722078291983, 1.0293387649193262, 1.0304531353063502, 1.0319154044577403, 1.0337251813209074, 1.0358815965700563, 1.0383833018952524, 1.0412284703422579, 1.0444147977082157, 1.047939504995496, 1.0517993419224316, 1.0559905914869347, 1.0605090755753313, 1.0653501616058894, 1.0705087701932519, 1.0759793838167298, 1.0817560564725264, 1.0878324242867954, 1.0942017170634268, 1.1008567707377666, 1.1077900407044377, 1.1149936159849365, 1.1224592341979303, 1.1301782972929537, 1.1381418880055376, 1.1463407869900408, 1.154765490583999, 1.163406229156334, 1.1722529859896704, 1.1812955166458439, 1.1905233687620114, 1.1999259022238211, 1.2094923096609842, 1.2192116372098547, 1.2290728054870075, 1.2390646307173294, 1.249175845960133, 1.2593951223764182, 1.2697110904810363, 1.2801123613234515, 1.2905875475417214, 1.3011252842347776, 1.3117142495992453, 1.3223431852780172, 1.333000916369159, 1.3436763710451138, 1.3543585997339664, 1.36503679381596, 1.3757003037908144 ], [ 1.036872728034758, 1.0373306440150019, 1.0381321152968237, 1.0392776469314957, 1.0407672747329144, 1.0426005626121198, 1.0447766009337394, 1.0472940059055549, 1.0501509200091548, 1.0533450134766744, 1.0568734868154719, 1.060733074379453, 1.0649200489825263, 1.0694302275466174, 1.074258977773378, 1.0794012258257706, 1.084851465002321, 1.0906037653841576, 1.096651784431529, 1.1029887785039347, 1.1096076152749086, 1.1165007870098025, 1.1236604246722863, 1.131078312822757, 1.1387459052692879, 1.146654341429629, 1.154794463360499, 1.1631568334085038, 1.1717317524350541, 1.1805092785660936, 1.1894792464158763, 1.1986312867327062, 1.2079548464134393, 1.217439208832521, 1.2270735144306415, 1.2368467815073834, 1.24674792716203, 1.2567657883263015, 1.266889142832926, 1.2771067304641281, 1.28740727392441, 1.2977794996826988, 1.3082121586296225, 1.3186940464965882, 1.3292140239845713, 1.339761036551699, 1.350324133810235, 1.3608924884851625, 1.3714554148883855, 1.3820023868643863 ], [ 1.0460418286115807, 1.046539455554425, 1.0473767427938823, 1.048554139605716, 1.0500716307759412, 1.051928734057579, 1.054124498639962, 1.0566575046413922, 1.059525863632796, 1.0627272201970404, 1.0662587545255588, 1.0701171860506107, 1.0742987781085873, 1.0787993436264949, 1.083614251820661, 1.088738435893641, 1.0941664017121682, 1.0998922374460074, 1.105909624144611, 1.1122118472255287, 1.1187918088457542, 1.125642041124462, 1.1327547201829058, 1.1401216809648123, 1.1477344327981842, 1.1555841756571188, 1.1636618170802446, 1.1719579897003078, 1.180463069337612, 1.1891671936085377, 1.1980602809986296, 1.2071320503487015, 1.2163720407010528, 1.2257696314521043, 1.2353140627569916, 1.2449944561309718, 1.2547998351923348, 1.2647191464910952, 1.2747412803680078, 1.2848550917883792, 1.2950494210958368, 1.3053131146315564, 1.3156350451653327, 1.3260041320858555, 1.3364093612985999, 1.3468398047810264, 1.357284639746405, 1.3677331673689446, 1.3781748310249067, 1.3885992340061246 ], [ 1.055647704379003, 1.0561860889193966, 1.0570600478984258, 1.0582699732665322, 1.059815797474462, 1.0616969910557923, 1.0639125612121636, 1.066461051411525, 1.069340542006787, 1.0725486518792435, 1.0760825411079968, 1.0799389146636225, 1.0841140271211192, 1.0886036883841799, 1.093403270409641, 1.0985077149179376, 1.1039115420723529, 1.1096088601068954, 1.1155933758796075, 1.1218584063253567, 1.1283968907793211, 1.1352014041396843, 1.1422641708355141, 1.1495770795632438, 1.1571316987529092, 1.1649192927230259, 1.1729308384808688, 1.1811570431230605, 1.189588361789574, 1.1982150161225518, 1.2070270131800247, 1.2160141647532625, 1.2251661070353699, 1.2344723205879107, 1.2439221505515317, 1.253504827046087, 1.2632094857053309, 1.273025188291197, 1.2829409433325878, 1.2929457267339506, 1.3030285022992072, 1.313178242117258, 1.3233839467561004, 1.3336346652134128, 1.3439195145727747, 1.354227699315841, 1.3645485302422984, 1.3748714429510542, 1.3851860158379083, 1.395481987566729 ], [ 1.065677079993814, 1.0662572141715172, 1.0671686517494998, 1.0684117258806494, 1.0699863154436735, 1.0718918427547885, 1.0741272722717548, 1.0766911103000782, 1.0795814057085875, 1.0827957516582496, 1.086331288345284, 1.0901847067565091, 1.0943522534317645, 1.0988297362251669, 1.1036125310540361, 1.108695589621098, 1.1140734480927077, 1.1197402367128555, 1.1256896903297926, 1.1319151598093107, 1.1384096243059865, 1.1451657043609833, 1.152175675792558, 1.1594314843428524, 1.166924761042324, 1.1746468382509732, 1.1825887663334202, 1.1907413309230657, 1.199095070728708, 1.2076402958355548, 1.216367106451014, 1.2252654120444657, 1.2343249508291412, 1.2435353095333415, 1.2528859434075381, 1.2623661964133592, 1.2719653215401285, 1.2816725011945393, 1.291476867609024, 1.3013675232146817, 1.3113335609249506, 1.3213640842769432, 1.3314482273780675, 1.341575174606478, 1.3517341800151985, 1.3619145863908237, 1.3721058439193785, 1.3822975284134011, 1.3924793590561033, 1.40264121562037 ], [ 1.076115937551273, 1.0767387556817645, 1.0776884269659213, 1.0789652243682668, 1.0805689720328235, 1.0824990431271813, 1.084754358667985, 1.0873333873374376, 1.0902341462974277, 1.0934542030050522, 1.096990678030148, 1.1008402488725257, 1.104999154773551, 1.1094632025136524, 1.114227773184363, 1.1192878299204647, 1.124637926574835, 1.130272217315757, 1.136184467123529, 1.1423680631604012, 1.148816026985282, 1.1555210275818895, 1.162475395166643, 1.169671135740087, 1.1770999463434406, 1.184753230979664, 1.192622117156424, 1.2006974730065008, 1.2089699249394688, 1.2174298757768696, 1.226067523321792, 1.2348728793125014, 1.243835788708751, 1.252945949258499, 1.262192931292168, 1.2715661976909758, 1.2810551239756691, 1.2906490184617554, 1.3003371424275074, 1.3101087302412178, 1.3199530093945178, 1.3298592203894146, 1.339816636427248, 1.3498145828489214, 1.3598424562767817, 1.369889743409869, 1.379946039425739, 1.3900010659435833, 1.4000446885052649, 1.410066933532563 ], [ 1.0869495492645054, 1.087615924943332, 1.0886045305786032, 1.0899155776407807, 1.0915488344540236, 1.0935036241756297, 1.0957788237455532, 1.0983728638152328, 1.1012837296619429, 1.1045089630920941, 1.1080456653338084, 1.111890500916203, 1.1160397025297717, 1.1204890768592801, 1.1252340113775827, 1.13026948208584, 1.1355900621827162, 1.1411899316421266, 1.1470628876765656, 1.153202356059928, 1.1596014032814588, 1.1662527494995774, 1.1731487822620403, 1.180281570956475, 1.1876428819530853, 1.1952241943991968, 1.2030167166234331, 1.211011403105286, 1.219198971964387, 1.227569922922153, 1.2361145556870947, 1.2448229887139959, 1.2536851782860525, 1.2626909378683153, 1.2718299576800696, 1.2810918244333382, 1.2904660411844109, 1.2999420472451744, 1.3095092381011417, 1.3191569852833078, 1.3288746561414448, 1.3386516334669845, 1.3484773349146053, 1.3583412321723973, 1.3682328698318318, 1.3781418839098964, 1.3880580199772812, 1.3979711508481536, 1.4078712937886828, 1.4177486272034638 ], [ 1.09816251211889, 1.098873255370342, 1.0999014389589428, 1.1012472116439818, 1.102910284925183, 1.1048899311603324, 1.1071849826412157, 1.1097938316366562, 1.112714431408564, 1.1159442982040044, 1.119480514223339, 1.1233197315616055, 1.1274581771172727, 1.1318916584596048, 1.1366155706428736, 1.1416249039528388, 1.1469142525678773, 1.1524778241144815, 1.1583094500939821, 1.1644025971545924, 1.1707503791804539, 1.17734557016654, 1.1841806178461212, 1.191247658035003, 1.1985385296545945, 1.2060447903937912, 1.2137577329677836, 1.221668401929942, 1.229767610991523, 1.238045960802226, 1.2464938571434971, 1.2551015294851644, 1.2638590498551592, 1.2727563519711356, 1.2817832505823037, 1.2909294609691957, 1.3001846185489667, 1.3095382985336865, 1.3189800355891217, 1.3284993434419146, 1.338085734383381, 1.3477287386189274, 1.3574179234127755, 1.367142911978764, 1.3768934020689885, 1.386659184213582, 1.3964301595661122, 1.406196357310896, 1.4159479515901408, 1.4256752779107587 ], [ 1.109738784387185, 1.110494638967771, 1.1115629846281565, 1.1129439062911992, 1.1146370577112008, 1.1166416597323185, 1.1189564994931016, 1.1215799305855119, 1.1245098741739603, 1.1277438210770145, 1.1312788348115173, 1.135111555596004, 1.139238205307334, 1.1436545933815645, 1.148356123647154, 1.1533378020758018, 1.1585942454332339, 1.164119690809647, 1.1699080060066323, 1.1759527007548451, 1.1822469387340255, 1.1887835503645787, 1.1955550463374485, 1.2025536318467935, 1.209771221487804, 1.217199454779939, 1.2248297122740344, 1.2326531321998688, 1.2406606276093026, 1.248842903968544, 1.2571904771518816, 1.2656936917880623, 1.274342739909556, 1.2831276798541924, 1.2920384553680058, 1.3010649148577749, 1.3101968307414047, 1.3194239188443513, 1.328735857790296, 1.3381223083346523, 1.3475729325899213, 1.357077413092584, 1.3666254716619641, 1.376206888002617, 1.3858115180027968, 1.3954293116829095, 1.4050503307493967, 1.4146647657109148, 1.4242629525155939, 1.4338353886697939 ], [ 1.1216617238841944, 1.1224633647507734, 1.1235723948252538, 1.1249888341637229, 1.126712277940388, 1.1287418948492023, 1.1310764264390172, 1.1337141873901346, 1.1366530667375194, 1.1398905300428246, 1.1434236225148344, 1.1472489730747282, 1.1513627993600597, 1.1557609136580673, 1.1604387297564775, 1.1653912706967593, 1.1706131774123028, 1.1760987182310414, 1.181841799219447, 1.187835975342215, 1.1940744624093516, 1.2005501497800273, 1.2072556137901358, 1.2141831318683216, 1.2213246973030623, 1.2286720346214854, 1.236216615538636, 1.2439496754342985, 1.2518622303128715, 1.2599450942003232, 1.268188896931138, 1.2765841022769346, 1.2851210263676143, 1.2937898563550947, 1.302580669269178, 1.3114834510146027, 1.3204881154582055, 1.3295845235550465, 1.3387625024624612, 1.3480118645913286, 1.3573224265443606, 1.3666840278918282, 1.376086549735993, 1.3855199330164587, 1.3949741965099265, 1.4044394544788923, 1.4139059339256257, 1.4233639914089693, 1.432804129383565, 1.4422170120226763 ], [ 1.1339141278331792, 1.1347621587851162, 1.1359123317049236, 1.1373646008492353, 1.1391185020663726, 1.1411731513433536, 1.1435272442734368, 1.1461790564516399, 1.1491264448031122, 1.1523668498460875, 1.1558972988887763, 1.1597144101563206, 1.1638143978413444, 1.1681930780687768, 1.1728458757626181, 1.1777678323998206, 1.182953614633506, 1.188397523765056, 1.1940935060420903, 1.2000351637566606, 1.2062157671155402, 1.2126282668520885, 1.2192653075469215, 1.2261192416223217, 1.2331821439733115, 1.240445827196428, 1.2479018573752703, 1.2555415703803787, 1.2633560886393496, 1.2713363383317866, 1.2794730669624985, 1.2877568612651702, 1.2961781653880262, 1.3047272993121366, 1.3133944774525492, 1.3221698273920393, 1.3310434086971041, 1.3400052317657076, 1.349045276656584, 1.3581535118500974, 1.367319912891266, 1.3765344808660953, 1.3857872606633435, 1.3950683589747481, 1.4043679619878469, 1.4136763527269856, 1.4229839279993688, 1.432281214904704, 1.4415588868686673, 1.4508077791622802 ], [ 1.14647827421039, 1.147373225714493, 1.148564934030385, 1.150053286782868, 1.151837759839763, 1.1539174160062973, 1.1562909046266319, 1.1589564620996256, 1.1619119133130962, 1.165154673998269, 1.168681754003098, 1.172489761480564, 1.1765749079851582, 1.1809330144679313, 1.185559518157842, 1.1904494803142933, 1.1955975948330688, 1.2009981976852642, 1.2066452771661424, 1.2125324849284576, 1.2186531477721332, 1.2250002801600628, 1.2315665974273702, 1.2383445296494415, 1.2453262361318855, 1.2525036204838667, 1.2598683462342455, 1.2674118529485332, 1.2751253728030671, 1.282999947571506, 1.2910264459775949, 1.2991955813670537, 1.307497929650672, 1.3159239474699784, 1.324463990536312, 1.333108332093771, 1.3418471814564283, 1.3506707025700806, 1.3595690325490237, 1.3685323001387844, 1.3775506440560041, 1.3866142311576586, 1.3957132743923604, 1.4048380504876579, 1.4139789173283581, 1.4231263309821156, 1.432270862330124, 1.4414032132621921, 1.450514232397197, 1.4595949302918763 ], [ 1.159335964428705, 1.160278291634931, 1.1615118602210188, 1.1630364904501236, 1.164851597648218, 1.1669561910476216, 1.1693488735239377, 1.1720278422330437, 1.1749908901520039, 1.1782354085252114, 1.1817583902141555, 1.1855564339465914, 1.189625749458115, 1.193962163516312, 1.1985611268150802, 1.2034177217238968, 1.2085266708742062, 1.2138823465625226, 1.2194787809472023, 1.2253096770134968, 1.231368420278993, 1.2376480912093022, 1.244141478311626, 1.2508410918717383, 1.2577391782979752, 1.26482773503388, 1.272098525999477, 1.2795430975196371, 1.2871527946963137, 1.294918778180451, 1.3028320412979153, 1.31088342748308, 1.3190636479726454, 1.3273632997117681, 1.3357728834240885, 1.3442828217967848, 1.352883477731807, 1.3615651726143285, 1.370318204549728, 1.3791328665207656, 1.3879994644170224, 1.3969083348895823, 1.4058498629845388, 1.4148144995101168, 1.423792778093163, 1.4327753318822414, 1.4417529098558606, 1.4507163926960223, 1.459656808188887, 1.4685653461162773 ], [ 1.1724685672165327, 1.17345864817193, 1.1747343326096273, 1.1762953728059389, 1.1781411230787586, 1.1802705387817756, 1.1826821761780109, 1.1853741931988648, 1.18834435109223, 1.191590016960462, 1.1951081671863935, 1.1988953917428637, 1.202947899378436, 1.2072615236694433, 1.211831729925671, 1.2166536229344334, 1.2217219555251113, 1.2270311379338268, 1.2325752479451604, 1.2383480417857262, 1.2443429657417278, 1.2505531684707003, 1.256971513975179, 1.2635905952042146, 1.270402748246609, 1.2774000670779115, 1.2845744188216282, 1.291917459483453, 1.2994206501159893, 1.3070752733700999, 1.3148724503880351, 1.322803157992415, 1.3308582461243967, 1.3390284554838223, 1.3473044353234975, 1.355676761349657, 1.3641359536804103, 1.3726724948140399, 1.3812768475592603, 1.389939472879899, 1.3986508476069754, 1.4074014819718919, 1.4161819369152753, 1.4249828411270038, 1.433794907774151, 1.4426089508748245, 1.451415901277366, 1.4602068222058322, 1.4689729243345209, 1.4777055803559869 ], [ 1.1858570635441064, 1.1868951976115798, 1.1882131827599962, 1.1898107027599978, 1.1916870505519046, 1.193841127391832, 1.1962714428628598, 1.1989761157568029, 1.2019528758298201, 1.2051990664322705, 1.208711648010638, 1.212487202476747, 1.2165219384366979, 1.2208116972694716, 1.2253519600423293, 1.2301378552477655, 1.2351641673439377, 1.2404253460783006, 1.245915516571429, 1.2516284901358525, 1.2575577758023464, 1.2636965925238965, 1.2700378820254954, 1.2765743222658694, 1.2832983414754386, 1.2902021327328952, 1.2972776690413412, 1.304516718863217, 1.3119108620720326, 1.3194515062776642, 1.3271299034808628, 1.3349371670117625, 1.3428642887063706, 1.3509021562745527, 1.359041570812333, 1.36727326441144, 1.3755879178185333, 1.3839761780969089, 1.392428676243542, 1.4009360447147783, 1.4094889348145516, 1.4180780338995822, 1.426694082357097, 1.4353278903114026, 1.443970354016917, 1.4526124718965265, 1.4612453601855644, 1.4698602681432607, 1.4784485927951772, 1.487001893171964 ], [ 1.1994820924456528, 1.2005684989335819, 1.2019288976919236, 1.2035629035748063, 1.2054697478734924, 1.2076482776155983, 1.210096955714587, 1.212813861974781, 1.2157966949546297, 1.2190427746882861, 1.2225490462630275, 1.2263120842473894, 1.2303280979622582, 1.23459293758466, 1.2391021010712555, 1.2438507418861438, 1.2488336775149766, 1.2540453987449776, 1.25948007968804, 1.2651315885217678, 1.2709934989210645, 1.2770591021507485, 1.2833214197875686, 1.2897732170380458, 1.29640701661682, 1.303215113148269, 1.3101895880527845, 1.317322324877472, 1.3246050250297914, 1.3320292238714746, 1.3395863071290086, 1.3472675275760888, 1.3550640219427925, 1.3629668280055358, 1.3709669018116208, 1.3790551349918303, 1.3872223721144812, 1.3954594280345074, 1.4037571051912123, 1.4121062108089122, 1.420497573955194, 1.4289220624121557, 1.437370599316987, 1.445834179529124, 1.4543038856825392, 1.462770903882817, 1.4712265390102475, 1.4796622295916526, 1.488069562205326, 1.4964402853851952 ], [ 1.2133239975833092, 1.2144588145909714, 1.215861666857955, 1.217532100020082, 1.2194692835472742, 1.2216720101966314, 1.2241386963008563, 1.2268673828967525, 1.2298557376961627, 1.2331010578989974, 1.2366002738455382, 1.2403499535026454, 1.244346307775887, 1.2485851966370707, 1.2530621360541199, 1.257772305707778, 1.2627105574771536, 1.2678714246736105, 1.273249132000377, 1.2788376062127713, 1.2846304874518506, 1.2906211412221378, 1.2968026709821812, 1.303167931314564, 1.3097095416404871, 1.316419900442102, 1.3232911999544288, 1.3303154412871154, 1.3374844499351815, 1.3447898916365517, 1.3522232885334142, 1.3597760355934088, 1.3674394172460929, 1.3752046241895632, 1.3830627703216376, 1.3910049097500607, 1.3990220538357745, 1.4071051882237051, 1.4152452898156647, 1.4234333436403022, 1.4316603595758115, 1.4399173888816033, 1.448195540496231, 1.4564859970596982, 1.4647800306195602, 1.4730690179814332, 1.4813444556660011, 1.4895979744361347, 1.4978213533593085, 1.5060065333724353 ], [ 1.2273628743961442, 1.2285461578794963, 1.2299914297137802, 1.2316981661248418, 1.2336654746889355, 1.2358920939402973, 1.2383763937988213, 1.2411163768221385, 1.2441096802840705, 1.247353579078613, 1.2508449894464735, 1.2545804735183834, 1.258556244667001, 1.2627681736567318, 1.2672117955782514, 1.2718823175521428, 1.2767746271835674, 1.281883301747653, 1.28720261808284, 1.292726563167389, 1.29844884535192, 1.3043629062189352, 1.3104619330382976, 1.3167388717857016, 1.3231864406895315, 1.3297971442698215, 1.336563287831524, 1.3434769923729597, 1.3505302098690333, 1.357714738887802, 1.3650222404978456, 1.3724442544233635, 1.3799722154029401, 1.3875974697077618, 1.3953112917744304, 1.4031049009075314, 1.4109694780070046, 1.4188961822754802, 1.4268761678610853, 1.4349006003915565, 1.4429606733562317, 1.451047624293082, 1.459152750738878, 1.467267425901678, 1.4753831140158007, 1.4834913853409695, 1.491583930768498, 1.4996525759990464, 1.5076892952581031, 1.515686224517032 ], [ 1.241578617676532, 1.2428103407377022, 1.2442979237228615, 1.246040773366947, 1.248037935380768, 1.2502880942134802, 1.252789573619604, 1.255540338034641, 1.258537994760594, 1.2617797969604019, 1.2652626474578357, 1.2689831033368524, 1.2729373813319727, 1.2771213639988515, 1.2815306066516738, 1.2861603450517025, 1.2910055038289314, 1.2960607056164404, 1.3013202808749316, 1.3067782783826067, 1.3124284763635878, 1.3182643942260162, 1.3242793048790356, 1.330466247596151, 1.336818041390651, 1.3433272988672829, 1.3499864405128876, 1.3567877093873575, 1.3637231861751298, 1.3707848045563287, 1.3779643668558044, 1.3852535599274696, 1.3926439712308865, 1.4001271050563535, 1.407694398854631, 1.415337239627199, 1.423046980332946, 1.4308149562672838, 1.4386325013701406, 1.4464909644195154, 1.454381725068054, 1.4622962096807788, 1.4702259069329353, 1.4781623831281072, 1.4860972971976765, 1.4940224153441977, 1.5019296252925483, 1.509810950114183, 1.5176585615916511, 1.525464793092012 ], [ 1.2559509694149205, 1.2572310218181857, 1.25876073263483, 1.2605394391390228, 1.2625661253052276, 1.2648394217256456, 1.2673576063165608, 1.2701186058170935, 1.2731199980813652, 1.2763590151625595, 1.2798325471852796, 1.2835371469997077, 1.2874690356091283, 1.291624108359612, 1.2959979418784904, 1.300585801745831, 1.305382650880829, 1.3103831586227954, 1.3155817104842435, 1.3209724185514233, 1.3265491325057084, 1.3323054512371206, 1.3382347350196564, 1.3443301182160885, 1.3505845224784485, 1.3569906704087846, 1.363541099643368, 1.3702281773222889, 1.37704411490528, 1.3839809832933687, 1.3910307282154302, 1.3981851858376502, 1.405436098553599, 1.412775130911976, 1.4201938856389345, 1.4276839197116775, 1.4352367604401395, 1.4428439215136215, 1.4504969189696018, 1.4581872870424846, 1.4659065938505424, 1.4736464568801448, 1.4813985582272098, 1.4891546595568714, 1.4969066167434741, 1.5046463941543364, 1.5123660785420552, 1.520057892511679, 1.5277142075306616, 1.535327556451291 ], [ 1.2704595667541956, 1.2717877546702867, 1.2733593348771524, 1.2751735753295181, 1.2772293984954908, 1.2795253814288006, 1.2820597566142213, 1.2848304135889526, 1.2878349013406796, 1.291070431480465, 1.2945338821863543, 1.2982218029111874, 1.3021304198457082, 1.3062556421257547, 1.3105930687699658, 1.3151379963321577, 1.3198854272502956, 1.3248300788717327, 1.329966393132362, 1.3352885468651505, 1.3407904627116305, 1.3464658206079776, 1.352308069815533, 1.3583104414639005, 1.3644659615731294, 1.3707674645201455, 1.3772076069130383, 1.383778881835712, 1.3904736334242747, 1.3972840717355628, 1.404202287867363, 1.4112202692891784, 1.418329915341905, 1.425523052864352, 1.4327914519042264, 1.4401268414712236, 1.4475209252897439, 1.4549653975091528, 1.4624519583296127, 1.4699723295021734, 1.4775182696623235, 1.485081589457015, 1.4926541664260706, 1.5002279595998562, 1.5077950237763398, 1.5153475234418508, 1.5228777463012708, 1.5303781163849401, 1.537841206701051, 1.5452597514040916 ], [ 1.2850839898951831, 1.2864600358749196, 1.2880731519000297, 1.2899225368581289, 1.2920070520415736, 1.294325221374259, 1.2968752323954957, 1.2996549380033804, 1.3026618589578942, 1.3058931871415191, 1.3093457895729643, 1.313016213167168, 1.3169006902324878, 1.3209951446936783, 1.325295199026944, 1.329796181891252, 1.3344931364376424, 1.3393808292764815, 1.3444537600801814, 1.3497061717971874, 1.3551320614508842, 1.3607251914954033, 1.3664791016984317, 1.372387121519568, 1.3784423829511532, 1.384637833787161, 1.390966251284274, 1.3974202561782845, 1.4039923270177215, 1.4106748147757477, 1.4174599577006237, 1.424339896364286, 1.4313066888681367, 1.4383523261647984, 1.445468747454297, 1.4526478556130555, 1.4598815326142922, 1.4671616548983726, 1.4744801086522856, 1.4818288049577077, 1.4891996947678696, 1.496584783674154, 1.5039761464242642, 1.5113659411548532, 1.518746423302646, 1.5261099591592744, 1.5334490390366218, 1.5407562900107337, 1.5480244882140928, 1.5552465706476584 ], [ 1.2998038097961582, 1.30122735297353, 1.3028815963157205, 1.3047656700060306, 1.3068783745918606, 1.309218181365488, 1.3117832334856718, 1.31457134784213, 1.3175800176626238, 1.320806415860115, 1.3242473991152626, 1.327899512687145, 1.331758995942896, 1.3358217885947046, 1.3400835376303466, 1.3445396049213232, 1.349185075490496, 1.3540147664189501, 1.3590232363700236, 1.3642047957061776, 1.3695535171728037, 1.375063247121053, 1.3807276172402057, 1.3865400567684465, 1.3924938051494606, 1.3985819251007785, 1.4047973160587148, 1.411132727963428, 1.4175807753466776, 1.4241339516840417, 1.4307846439724479, 1.437525147493439, 1.4443476807219569, 1.4512444003401934, 1.4582074163158307, 1.4652288070039312, 1.4723006342318699, 1.4794149583268428, 1.4865638530459775, 1.493739420369514, 1.5009338051181067, 1.508139209356249, 1.5153479065445308, 1.5225522554046045, 1.5297447134618423, 1.5369178502319136, 1.5440643600188813, 1.5511770742939948, 1.5582489736257155, 1.5652731991334137 ], [ 1.3145986355109571, 1.3160692320349856, 1.317764119675264, 1.3196823603832462, 1.3218226944915716, 1.3241835412479952, 1.326763000073793, 1.3295588525482382, 1.3325685651184744, 1.3357892925318893, 1.3392178819859053, 1.3428508779878254, 1.346684527915237, 1.3507147882651838, 1.3549373315782833, 1.3593475540216673, 1.3639405836127505, 1.3687112890635738, 1.3736542892237578, 1.3787639630979411, 1.3840344604119565, 1.3894597127002069, 1.3950334448849895, 1.4007491873170692, 1.4066002882453006, 1.4125799266817984, 1.4186811256279144, 1.424896765625182, 1.4312195985944784, 1.4376422619256763, 1.4441572927795363, 1.4507571425628272, 1.4574341915373277, 1.4641807635230553, 1.4709891406558468, 1.4778515781594628, 1.4847603190924064, 1.4917076090300554, 1.4986857106428737, 1.5056869181322345, 1.5127035714858397, 1.5197280705156113, 1.52675288864187, 1.533770586388497, 1.5407738245551075, 1.5477553770334316, 1.554708143236366, 1.56162516010989, 1.5684996136992753, 1.5753248502429378 ], [ 1.3294481610129343, 1.330965284706798, 1.3327002597282318, 1.3346520803779474, 1.336819427402411, 1.339200668679861, 1.341793860614359, 1.344596750239029, 1.3476067780273302, 1.3508210814091328, 1.3542364989862448, 1.3578495754397133, 1.361656567119173, 1.3656534483023757, 1.3698359181108875, 1.3741994080658333, 1.3787390902656709, 1.3834498861658908, 1.3883264759385838, 1.3933633083881858, 1.3985546113977276, 1.4038944028783058, 1.4093765021929578, 1.4149945420246, 1.4207419806562116, 1.4266121146302968, 1.4325980917534362, 1.4386929244106297, 1.4448895031533089, 1.45118061052403, 1.4575589350801863, 1.464017085578581, 1.4705476052822621, 1.4771429863507255, 1.4837956842745608, 1.4904981323154454, 1.4972427559127377, 1.5040219870179843, 1.51082827831925, 1.5176541173175346, 1.5244920402183906, 1.5313346456025039, 1.538174607839984, 1.5450046902141263, 1.5518177577215562, 1.558606789516892, 1.5653648909714906, 1.5720853053172164, 1.5787614248477237, 1.5853868016514194 ], [ 1.3443322113551077, 1.3458952546000713, 1.3476696870141505, 1.3496544359357117, 1.3518481232507198, 1.3542490662295987, 1.356855279055583, 1.3596644750452302, 1.3626740695595476, 1.365881183602201, 1.3692826480990308, 1.3728750088510069, 1.3766545321507284, 1.3806172110503494, 1.3847587722668808, 1.3890746837087231, 1.393560162605381, 1.3982101842203072, 1.4030194911250216, 1.4079826030109275, 1.4130938270133662, 1.4183472685209932, 1.423736842441969, 1.4292562848969173, 1.4348991653074707, 1.4406588988477613, 1.4465287592252747, 1.4525018917563894, 1.4585713267010472, 1.4647299928202697, 1.4709707311196265, 1.4772863087411243, 1.4836694329658362, 1.490112765289136, 1.496608935530425, 1.5031505559392329, 1.50973023525972, 1.5163405927159184, 1.522974271880478, 1.5296239543901835, 1.5362823734723077, 1.5429423272464784, 1.5495966917678397, 1.5562384337782174, 1.5628606231331537, 1.569456444873931, 1.576019210915088, 1.5825423713192945, 1.5890195251330461, 1.5954444307582185 ], [ 1.3592307880204773, 1.3608390628614941, 1.3626522506381389, 1.3646692125204742, 1.3668885123552226, 1.3693084176519608, 1.3719269012442141, 1.3747416436256037, 1.3777500359591455, 1.3809491837557943, 1.3843359112161282, 1.3879067662271318, 1.3916580260038562, 1.3955857033638126, 1.3996855536198798, 1.4039530820756037, 1.408383552104736, 1.4129719937951972, 1.4177132131356487, 1.4226018017212456, 1.4276321469534192, 1.4327984427070715, 1.4380947004369249, 1.4435147606935201, 1.4490523050179824, 1.4547008681835665, 1.4604538507508151, 1.46630453190231, 1.4722460825221273, 1.4782715784843083, 1.484374014114254, 1.4905463157862249, 1.4967813556200777, 1.5030719652398887, 1.5094109495572914, 1.5157911005421565, 1.5222052109436979, 1.528646087925119, 1.5351065665755805, 1.5415795232637584, 1.548057888797864, 1.5545346613579225, 1.5610029191669874, 1.5674558328690045, 1.5738866775821225, 1.5802888445975767, 1.5866558526955776, 1.5929813590510087, 1.599259169703342, 1.605483249566699 ], [ 1.374124113321056, 1.3757768527899965, 1.3776280230875817, 1.3796764201133758, 1.3819205505899088, 1.3843586331964854, 1.3869886003612453, 1.3898081007111371, 1.3928145021775256, 1.3960048957531668, 1.3993760998941536, 1.402924665558506, 1.4066468818710576, 1.4105387824022764, 1.4145961520467698, 1.4188145344852723, 1.4231892402120472, 1.427715355107897, 1.4323877495371566, 1.4372010879453938, 1.4421498389329521, 1.44722828577795, 1.4524305373809272, 1.457750539601934, 1.4631820869597403, 1.468718834661562, 1.4743543109308277, 1.480081929599463, 1.4858950029304667, 1.4917867546358423, 1.4977503330543858, 1.50377882445344, 1.5098652664183765, 1.5160026612934177, 1.5221839896373912, 1.528402223657974, 1.5346503405884058, 1.5409213359706917, 1.547208236810071, 1.553504114565855, 1.55980209794463, 1.5660953854624589, 1.5723772577438193, 1.578641089525879, 1.5848803613379598, 1.591088670827266, 1.5972597437031724, 1.6033874442739435, 1.6094657855511336, 1.6154889388985199 ], [ 1.3889926737088405, 1.3906890333605815, 1.3925773439516533, 1.394656337110594, 1.3969244634425508, 1.3993798938088613, 1.402020521248043, 1.404843963537666, 1.4078475663942276, 1.4110284073065276, 1.4143832999958232, 1.4179087994941897, 1.4216012078305493, 1.4254565803119004, 1.4294707323853384, 1.4336392470647294, 1.4379574829039667, 1.4424205824970333, 1.4470234814834764, 1.4517609180361506, 1.4566274428066281, 1.46161742930224, 1.4667250846671818, 1.4719444608390555, 1.4772694660508308, 1.4826938766472366, 1.488211349183602, 1.4938154327742597, 1.499499581656936, 1.5052571679388416, 1.5110814944897686, 1.5169658079469737, 1.5229033117964634, 1.528887179495157, 1.5349105675982593, 1.5409666288564559, 1.547048525247618, 1.5531494409081854, 1.5592625949297085, 1.5653812539868157, 1.5714987447634294, 1.577608466144902, 1.5837039011447427, 1.5897786285355546, 1.5958263341549577, 1.6018408218585278, 1.607816024093069, 1.6137460120649672, 1.6196250054797947, 1.6254473818309383 ] ], "zauto": true, "zmax": 1.6254473818309383, "zmin": -1.6254473818309383 }, { "autocolorscale": false, "autocontour": true, "colorbar": { "tickfont": { "size": 8 }, "ticksuffix": "", "x": 1, "y": 0.5 }, "colorscale": [ [ 0.0, "rgb(255,247,251)" ], [ 0.14285714285714285, "rgb(236,231,242)" ], [ 0.2857142857142857, "rgb(208,209,230)" ], [ 0.42857142857142855, "rgb(166,189,219)" ], [ 0.5714285714285714, "rgb(116,169,207)" ], [ 0.7142857142857143, "rgb(54,144,192)" ], [ 0.8571428571428571, "rgb(5,112,176)" ], [ 1.0, "rgb(3,78,123)" ] ], "contours": { "coloring": "heatmap" }, "hoverinfo": "x+y+z", "ncontours": 25, "type": "contour", "x": [ 0.0, 0.02040816326530612, 0.04081632653061224, 0.061224489795918366, 0.08163265306122448, 0.1020408163265306, 0.12244897959183673, 0.14285714285714285, 0.16326530612244897, 0.18367346938775508, 0.2040816326530612, 0.22448979591836732, 0.24489795918367346, 0.26530612244897955, 0.2857142857142857, 0.3061224489795918, 0.32653061224489793, 0.3469387755102041, 0.36734693877551017, 0.3877551020408163, 0.4081632653061224, 0.42857142857142855, 0.44897959183673464, 0.4693877551020408, 0.4897959183673469, 0.5102040816326531, 0.5306122448979591, 0.5510204081632653, 0.5714285714285714, 0.5918367346938775, 0.6122448979591836, 0.6326530612244897, 0.6530612244897959, 0.673469387755102, 0.6938775510204082, 0.7142857142857142, 0.7346938775510203, 0.7551020408163265, 0.7755102040816326, 0.7959183673469387, 0.8163265306122448, 0.836734693877551, 0.8571428571428571, 0.8775510204081632, 0.8979591836734693, 0.9183673469387754, 0.9387755102040816, 0.9591836734693877, 0.9795918367346939, 1.0 ], "xaxis": "x2", "y": [ 0.0, 0.02040816326530612, 0.04081632653061224, 0.061224489795918366, 0.08163265306122448, 0.1020408163265306, 0.12244897959183673, 0.14285714285714285, 0.16326530612244897, 0.18367346938775508, 0.2040816326530612, 0.22448979591836732, 0.24489795918367346, 0.26530612244897955, 0.2857142857142857, 0.3061224489795918, 0.32653061224489793, 0.3469387755102041, 0.36734693877551017, 0.3877551020408163, 0.4081632653061224, 0.42857142857142855, 0.44897959183673464, 0.4693877551020408, 0.4897959183673469, 0.5102040816326531, 0.5306122448979591, 0.5510204081632653, 0.5714285714285714, 0.5918367346938775, 0.6122448979591836, 0.6326530612244897, 0.6530612244897959, 0.673469387755102, 0.6938775510204082, 0.7142857142857142, 0.7346938775510203, 0.7551020408163265, 0.7755102040816326, 0.7959183673469387, 0.8163265306122448, 0.836734693877551, 0.8571428571428571, 0.8775510204081632, 0.8979591836734693, 0.9183673469387754, 0.9387755102040816, 0.9591836734693877, 0.9795918367346939, 1.0 ], "yaxis": "y2", "z": [ [ 0.0412399699155888, 0.03943217098968745, 0.03768370387677248, 0.03599513908164852, 0.03436692226235275, 0.03279937630012167, 0.03129270657523632, 0.02984701038254166, 0.028462291579065265, 0.027138481710344116, 0.02587546899502414, 0.02467313663470682, 0.02353141192196682, 0.02245032748984383, 0.021430095706620175, 0.0204711965617301, 0.019574478269851966, 0.01874126805836769, 0.01797348799911794, 0.017273767136817206, 0.01664553655634944, 0.016093088807168365, 0.015621578347528572, 0.015236937452216525, 0.014945685376570988, 0.014754620691364632, 0.0146704090377877, 0.014699108108641577, 0.014845699420215085, 0.015113709481039062, 0.015504991219708424, 0.01601970052230432, 0.01665645560074672, 0.017412627527063403, 0.01828469214093682, 0.019268578350970726, 0.020359967479216607, 0.02155452175370653, 0.02284803931917449, 0.024236545053710826, 0.02571633156616411, 0.02728396514240211, 0.028936269327677334, 0.030670295897730467, 0.03248329011652864, 0.034372654813037605, 0.0363359160312785, 0.03837069176138136, 0.040474664435021505, 0.04264555735356218 ], [ 0.039686845458536055, 0.037885537090846653, 0.036145274039213734, 0.034466662398575855, 0.03285017151505657, 0.03129613271957549, 0.02980474084966867, 0.028376059544487856, 0.027010031497736026, 0.02570649505880331, 0.024465208765770786, 0.023285885551261154, 0.022168238445279344, 0.021112039554665306, 0.020117193847414273, 0.01918382870209341, 0.018312399142903554, 0.017503806968996376, 0.016759529359920436, 0.016081748762338394, 0.015473470826930636, 0.014938611117292395, 0.01448202523404989, 0.01410945301594069, 0.013827349045042743, 0.013642582904851371, 0.013562016173150296, 0.01359199679133718, 0.013737845532935394, 0.01400342820882483, 0.01439089744029363, 0.014900648108923513, 0.015531475918895487, 0.01628088196473762, 0.017145444748417202, 0.018121186924574675, 0.01920388711913448, 0.020389314110134216, 0.02167338212166541, 0.023052238652203655, 0.02452230114419065, 0.026080258601241288, 0.02772305156986312, 0.029447840510215702, 0.03125196944300234, 0.0331329292553176, 0.035088323223056925, 0.03711583606633853, 0.03921320705908702, 0.041378207234775366 ], [ 0.03819139113948952, 0.03639473777689532, 0.034660827550444334, 0.0329903273266458, 0.031383758632320465, 0.029841492935910072, 0.028363749142916884, 0.026950594312755947, 0.02560194885087369, 0.02431759769496166, 0.023097209280483342, 0.021940364312245858, 0.020846596546118812, 0.019815447839864987, 0.01884653958199457, 0.01793966213599474, 0.017094882981317318, 0.01631267257407686, 0.015594044314100176, 0.014940701093241953, 0.014355175497492404, 0.01384094394865346, 0.013402487742597453, 0.013045268193815024, 0.01277558271356766, 0.012600278606083103, 0.012526325624067977, 0.012560285741576019, 0.012707759046026217, 0.012972909876815982, 0.013358169991345084, 0.013864172350501086, 0.014489906849249185, 0.015233035577111866, 0.016090280604834733, 0.017057804434750662, 0.01813152988197393, 0.01930737644342332, 0.020581413560471235, 0.021949944298194177, 0.023409537451984607, 0.02495702522990374, 0.026589480382279783, 0.028304182862558914, 0.030098582755927746, 0.031970263627414744, 0.03391690861341558, 0.03593627037273565, 0.038026145262594034, 0.04018435166976173 ], [ 0.036757980918958676, 0.03496389244736835, 0.03323419058225021, 0.03156962780641951, 0.029970806926229516, 0.02843817297140667, 0.02697200656300872, 0.025572419732853187, 0.024239355473977996, 0.022972592634672346, 0.021771758122596564, 0.020636348733321985, 0.01956576521465053, 0.018559361360478855, 0.017616510903869325, 0.016736694620202247, 0.015919609184116088, 0.015165297712436998, 0.01447429926956729, 0.013847810564946455, 0.013287847334449172, 0.012797385446003158, 0.012380453303460416, 0.012042139713529092, 0.011788479055640663, 0.011626184092568182, 0.011562221314935164, 0.01160326434407724, 0.011755107294326526, 0.01202215140649861, 0.012407073570331686, 0.012910739117012937, 0.013532351989748734, 0.014269775162258812, 0.015119927063930247, 0.01607916846907448, 0.017143624270764712, 0.018309417647435124, 0.01957281878621436, 0.020930323491569768, 0.022378680928606984, 0.023914888232381245, 0.025536165947039006, 0.027239924193350182, 0.029023726007573355, 0.030885251704933205, 0.03282226633811598, 0.034832591173516315, 0.0369140794157752, 0.039064596023314545 ], [ 0.03539186163150742, 0.03359804219760415, 0.03187015466606902, 0.030209060207517416, 0.028615471191377816, 0.027089940052005854, 0.02563284870817154, 0.02424439942583998, 0.022924608355816008, 0.021673303382993506, 0.020490128379809604, 0.01937455643654986, 0.018325915096570604, 0.01734342698110042, 0.016426269338216754, 0.01557365584518681, 0.014784943235204167, 0.014059763749960784, 0.01339818171298618, 0.012800868296275743, 0.012269282458516181, 0.011805837955055848, 0.011414026843389644, 0.011098461043087818, 0.010864789447375863, 0.010719455166922154, 0.010669282036241854, 0.01072092261546897, 0.010880251190556188, 0.011151821947044543, 0.011538510175062553, 0.012041405790289108, 0.012659953733387285, 0.013392270812903612, 0.014235540019240073, 0.015186393629078766, 0.01624122890050128, 0.017396434956130077, 0.01864853455209243, 0.01999425719889973, 0.02143056337300116, 0.022954637507704056, 0.024563863383383226, 0.02625579137089182, 0.028028103549438764, 0.029878580210649923, 0.03180506957021503, 0.033805461444687566, 0.03587766502459128, 0.03801959053504142 ], [ 0.034099212896333685, 0.03230323082442331, 0.030574580249301344, 0.028914250477412078, 0.027323088944634633, 0.025801787773693942, 0.024350869841195902, 0.022970675055134896, 0.02166134791359302, 0.020422827883540936, 0.019254844700640927, 0.01815692132721403, 0.01712838796626611, 0.01616841113054756, 0.015276042175816186, 0.014450289742435696, 0.013690219967090366, 0.012995086822046904, 0.012364492149919235, 0.01179857048237941, 0.011298187188483971, 0.01086512975924686, 0.010502261649052338, 0.010213598059022725, 0.010004257658749268, 0.009880250227070526, 0.009848084577844002, 0.00991422572041246, 0.01008448457700999, 0.010363463641353642, 0.010754181293074172, 0.011257947856488574, 0.011874489219355848, 0.012602247010232027, 0.01343875579414385, 0.014381009138796351, 0.015425759769890829, 0.016569733854235352, 0.017809763912827063, 0.01914285684941173, 0.02056621628123409, 0.02207723605042717, 0.023673477716315994, 0.02535264079158263, 0.027112531227385973, 0.028951031309806505, 0.030866072575416244, 0.032855612388955714, 0.03491761426694586, 0.03705003173349869 ], [ 0.032887179645754834, 0.031086561788004036, 0.029354480861448998, 0.027692067962796448, 0.02610032583470719, 0.024580114303466922, 0.023132134151098355, 0.021756909818358264, 0.020454771694947714, 0.019225839247991382, 0.01807000688584629, 0.016986935247996292, 0.015976051517999742, 0.015036563289121067, 0.01416749131746664, 0.01336772694024913, 0.012636119696003067, 0.011971599362644837, 0.011373333780094143, 0.010840918996979849, 0.010374591117990042, 0.009975439670565937, 0.0096455910181013, 0.009388319425248872, 0.009208037215638745, 0.009110120870145517, 0.009100554035173786, 0.009185413134000599, 0.009370276148657063, 0.009659675898064726, 0.01005671931225545, 0.010562945830044829, 0.011178422666598489, 0.011902009978883991, 0.01273170169756977, 0.013664958896981572, 0.014698984278378045, 0.015830919017563456, 0.017057965927046163, 0.018377453872192792, 0.01978686080024452, 0.021283810606187777, 0.02286605535050872, 0.02453145069889048, 0.026277929528454244, 0.02810347654924844, 0.03000610540233654, 0.031983838836302354, 0.03403469206515584, 0.03615665914450749 ], [ 0.03176386189899089, 0.029956214336377678, 0.028218070048185478, 0.02655070756711592, 0.024955297139681858, 0.023432886727216197, 0.02198438550738336, 0.02061054485715038, 0.019311937080660636, 0.018088932590068968, 0.01694167689981962, 0.015870069689683887, 0.014873749333109974, 0.013952087620513752, 0.013104200779438998, 0.012328984023441611, 0.011625177315095492, 0.010991469236480336, 0.010426643181845087, 0.009929764928357792, 0.009500402638014459, 0.00913885961543328, 0.008846387685913767, 0.00862533731374044, 0.008479194079856957, 0.008412456440651283, 0.008430333283222529, 0.008538282900031384, 0.008741467280073538, 0.009044234294465752, 0.009449741353743449, 0.009959790720040117, 0.010574878732272875, 0.01129440256230824, 0.012116942531121415, 0.01304054634576288, 0.014062968450631444, 0.015181845935846837, 0.016394812463869944, 0.017699561738146182, 0.01909387467674089, 0.020575623037992763, 0.02214275932729364, 0.023793299830612995, 0.02552530517192157, 0.027336861006852963, 0.02922606026340475, 0.031190987580887924, 0.03322970614664731, 0.03534024687896303 ], [ 0.030738242915060606, 0.028921396983835633, 0.02717474648359317, 0.025499713282997518, 0.023897636736179537, 0.02236976234126506, 0.020917227352786574, 0.019541042851295775, 0.018242071886834223, 0.017021003580209464, 0.0158783235660384, 0.014814281985959576, 0.013828861476032748, 0.012921749279131747, 0.012092319685058684, 0.011339635200455452, 0.010662476647217676, 0.0100594129526161, 0.009528919675128967, 0.009069550280678101, 0.008680155235400755, 0.0083601313989857, 0.00810966959539396, 0.007929954856952614, 0.007823266643896199, 0.007792931425542444, 0.007843102487639116, 0.007978381638849574, 0.008203344807908504, 0.00852206887970323, 0.008937760696553386, 0.009452555426085026, 0.010067496094865288, 0.010782655973029142, 0.011597340484035965, 0.012510307710166077, 0.013519965416879907, 0.014624524517671093, 0.01582210575418158, 0.017110805837178243, 0.01848873276009525, 0.019954019861952534, 0.021504826488129073, 0.02313933101259199, 0.02485572013232401, 0.02665217691605255, 0.028526869078759523, 0.03047793828198975, 0.03250349083637722, 0.034601589929073015 ], [ 0.029820034909660977, 0.02799221264701021, 0.026234986343611683, 0.024549906871268595, 0.02293847228083423, 0.021402121379618267, 0.019942224380998096, 0.018560069699550392, 0.017256845817033312, 0.016033617072160104, 0.014891292325294483, 0.01383058586575939, 0.012851970867421143, 0.011955627392829092, 0.01114138959165788, 0.010408700340320457, 0.009756585718105878, 0.00918366535662445, 0.008688216052863853, 0.00826830290587993, 0.007921982848937663, 0.007647569661409653, 0.007443929826272498, 0.007310760108875381, 0.0072487871908827025, 0.007259833397701763, 0.007346713964194802, 0.0075129683996978894, 0.007762471929731803, 0.008099007025747729, 0.008525884315669282, 0.009045681391689039, 0.009660126990873727, 0.01037011598622532, 0.011175814011837567, 0.012076804424957012, 0.013072239283235906, 0.014160970904598233, 0.015341654243331875, 0.016612819606091293, 0.017972920041000776, 0.01942035931644493, 0.02095350617111535, 0.022570699507301138, 0.024270248029437346, 0.026050426787271593, 0.027909472263198398, 0.029845577045946682, 0.0318568847194526, 0.0339414853214062 ], [ 0.029019423035053685, 0.027179409310354077, 0.02541010879673572, 0.02371317843589279, 0.02209025342032618, 0.020542947721933824, 0.019072852692415435, 0.017681532586890175, 0.01637051540521329, 0.015141276891239458, 0.013995214932367122, 0.012933611106809293, 0.011957576025745828, 0.011067975915173533, 0.010265340294823757, 0.00954975543563704, 0.008920755956357721, 0.008377236774618445, 0.007917416953212478, 0.007538890795619915, 0.007238794020780367, 0.007014090809734139, 0.006861954266228947, 0.0067801789571813745, 0.006767543324224951, 0.006824041595669587, 0.006950930486928869, 0.007150578185591305, 0.007426149491976512, 0.007781197694334654, 0.008219249384065055, 0.008743458517953185, 0.009356376103611164, 0.01005984514766548, 0.01085500082674892, 0.011742340849134445, 0.012721830211065193, 0.013793012546891997, 0.014955110934641887, 0.016207110307686574, 0.017547819967397627, 0.018975918178861188, 0.020489982241036864, 0.0220885075953522, 0.023769919110370442, 0.025532577051386517, 0.027374779620440392, 0.02929476342246118, 0.03129070279854277, 0.03336070866033256 ], [ 0.028346695618887675, 0.02649399630279427, 0.024711884520802863, 0.023002096083299554, 0.021366374789129186, 0.01980648127398631, 0.018324201848894224, 0.016921356320065396, 0.015599803060826482, 0.014361438530174951, 0.013208186917093905, 0.012141973630138837, 0.011164674163688134, 0.01027802813304027, 0.009483508432383776, 0.008782139964921956, 0.008174274222939534, 0.0076593469711084, 0.007235673590946259, 0.006900359387448627, 0.00664940258039804, 0.0064780314046551015, 0.006381247946912347, 0.006354478214511092, 0.006394186773564443, 0.006498323851149946, 0.006666523393196786, 0.0069000362963222055, 0.007201440720732598, 0.007574209070580419, 0.00802222560757125, 0.008549340924832642, 0.009159024490941726, 0.009854142955599776, 0.010636860443861109, 0.011508635757327858, 0.012470282933028327, 0.013522063594486674, 0.014663787207738657, 0.015894904334349227, 0.017214585570790208, 0.0186217841150235, 0.020115282933455575, 0.021693728892974266, 0.023355656589482635, 0.025099504429235177, 0.026923625116662266, 0.02882629225049216, 0.030805704316425143, 0.03285998702080378 ], [ 0.02781176363285791, 0.025946722297158484, 0.02415197339417448, 0.02242930687669463, 0.02078054714737337, 0.019207570671154073, 0.01771232620288076, 0.01629685717785548, 0.014963324972315225, 0.013714030257138056, 0.012551427207131911, 0.01147812152125469, 0.010496837847176328, 0.00961033573966688, 0.008821247780644016, 0.008131813930258634, 0.0075435010718897305, 0.00705653533047725, 0.006669437646753876, 0.0063787180363304415, 0.006178902722237547, 0.006062995966894839, 0.006023325540949411, 0.0060525692403850815, 0.006144701484676502, 0.006295655569005892, 0.00650361365756882, 0.0067689433314314824, 0.0070938627768874826, 0.007481939744172003, 0.00793752791399419, 0.008465229391975714, 0.00906944838212422, 0.009754071969646075, 0.010522284626780523, 0.011376499719235222, 0.012318378001133048, 0.013348900076060367, 0.014468464193953106, 0.01567698861829661, 0.016974005913174006, 0.018358743060384593, 0.01983018578025659, 0.02138712801105312, 0.023028208706053606, 0.02475193844614733, 0.02655671823473925, 0.028440852503495734, 0.030402557964644347, 0.03243996957564791 ], [ 0.027423595034003965, 0.025547438240884356, 0.0237412091825956, 0.022006737210492795, 0.020345909003433815, 0.01876069455909727, 0.01725317872101234, 0.01582559864925502, 0.014480386852285093, 0.013220217707749693, 0.012048052150934047, 0.01096716946532926, 0.009981165824326857, 0.009093885989820446, 0.008309239480448295, 0.007630843727849243, 0.00706145207889266, 0.0066021887007614525, 0.0062517360583416, 0.006005760197884319, 0.005856901530006265, 0.005795500350992257, 0.005810913710673143, 0.005893023333307477, 0.00603350840064812, 0.006226633042671653, 0.006469514031542577, 0.0067619691887025254, 0.0071060872509263046, 0.0075056473717187615, 0.007965490157401, 0.008490918478555931, 0.00908718554801062, 0.009759106150964151, 0.010510803757807448, 0.01134558478303403, 0.012265915812020287, 0.013273472575155078, 0.014369230157292663, 0.015553569663582933, 0.01682638418585364, 0.01818717408756115, 0.019635127166843302, 0.02116918292295332, 0.022788082218738917, 0.02449040455880029, 0.026274595420249403, 0.02813898590886955, 0.03008180668292331, 0.03210119771657699 ], [ 0.02718961648042809, 0.025304403285390995, 0.023488793792680054, 0.021744657393975055, 0.020073941562002946, 0.01847870539412337, 0.01696116144211716, 0.015523727135195708, 0.014169086433654382, 0.012900260559326852, 0.011720682728417944, 0.010634264160589295, 0.00964542512913729, 0.00875904372120785, 0.007980248038541448, 0.00731395671501757, 0.00676408863127744, 0.006332462909934249, 0.0060176181353760695, 0.005814011870821188, 0.005712101454602127, 0.005699488489186662, 0.005762789163907779, 0.005889576332215713, 0.006069839888094406, 0.006296752316287149, 0.006566815515246247, 0.00687958197516304, 0.007237133862130499, 0.007643451459767781, 0.00810375715147509, 0.008623894368680144, 0.009209785997105653, 0.009867004121920847, 0.010600467689347384, 0.011414267300964455, 0.012311600810631412, 0.013294793396803185, 0.014365372736129332, 0.01552417268196817, 0.01677144496467006, 0.018106965391779, 0.019530127149363596, 0.02104001834547086, 0.022635483843349676, 0.02431517300932887, 0.02607757565424319, 0.02792104853631794, 0.029843834587063425, 0.03184407669125863 ], [ 0.02711515826691901, 0.025223624820266854, 0.023401509979630718, 0.021650739564555353, 0.019973338313306655, 0.01837147002186912, 0.0168474881294586, 0.015403998662169075, 0.014043936770395045, 0.012770656039938252, 0.011588024976795267, 0.010500515354026296, 0.009513249415889049, 0.008631944623646467, 0.00786265796710131, 0.007211204127252023, 0.006682148084371787, 0.006277420139393549, 0.005994891284282472, 0.0058275328060102705, 0.005763751828167606, 0.005788985765226151, 0.00588798504167014, 0.006046957652544134, 0.0062550177258639105, 0.00650482767281133, 0.006792612094907421, 0.007117788551280892, 0.007482406908991863, 0.007890514812397281, 0.00834751542488372, 0.008859558906713796, 0.009433000073513878, 0.010073949550208934, 0.01078793749089067, 0.01157969630618497, 0.012453054662973539, 0.013410923385321783, 0.014455347596729663, 0.015587598949275992, 0.016808285615556685, 0.018117463655616624, 0.01951473947125519, 0.020999358141760606, 0.022570276063255196, 0.02422621855724637, 0.0259657242754249, 0.027787178655009563, 0.029688838668178067, 0.031668850874557626 ], [ 0.027203028028426255, 0.02530834071196333, 0.023483089496109485, 0.02172928289416087, 0.020049050436853625, 0.018444688181484606, 0.016918715831273363, 0.015473947375784157, 0.014113576169273572, 0.01284127263099604, 0.011661286672279485, 0.010578534977456214, 0.009598632133123768, 0.00872779227430642, 0.007972489540608583, 0.007338745405962102, 0.0068309634511751075, 0.0064504241461131725, 0.006193873208522132, 0.006052881538863844, 0.006014498901204557, 0.00606311593561028, 0.0061828370662804066, 0.006359547693048928, 0.006582216526950437, 0.0068434117586415695, 0.0071392458717485195, 0.007468991444011071, 0.007834542223456234, 0.008239818825614104, 0.008690170132074352, 0.009191800092538569, 0.009751244170508565, 0.010374918988368334, 0.01106876551157372, 0.01183799782525142, 0.01268695768809796, 0.01361906317140125, 0.014636831184041186, 0.01574195019794125, 0.016935380681440088, 0.018217465011694352, 0.01958803408897825, 0.021046503056689092, 0.022591952650814793, 0.024223195542285702, 0.025938828730663634, 0.027737273877957675, 0.029616807728013637, 0.03157558467954779 ], [ 0.027453286861029116, 0.025558740257049798, 0.023733863975326147, 0.021980775074107492, 0.020301733771090614, 0.01869919232170762, 0.017175855261339475, 0.0157347521333575, 0.014379322163751368, 0.013113506554072956, 0.011941836469783007, 0.010869491037012858, 0.00990227739258526, 0.009046454477393807, 0.008308293533088153, 0.007693270086587204, 0.00720486556348694, 0.006843162548839038, 0.0066036917653388766, 0.00647711914925241, 0.006450117169555501, 0.00650721143652035, 0.006632944963750117, 0.006813690136985153, 0.007038769173817598, 0.007300895162046195, 0.007596123448772945, 0.007923518032786951, 0.00828467968672202, 0.008683219812618423, 0.009124222855794107, 0.00961372142041701, 0.010158203892213384, 0.010764175378336651, 0.01143779246534056, 0.012184587453538842, 0.013009288545995161, 0.013915731518841266, 0.014906848904955356, 0.01598471699108904, 0.01715063959514946, 0.018405249828806564, 0.019748615320972242, 0.021180337174760193, 0.022699637211723155, 0.024305431326509072, 0.025996388957155014, 0.027770979933002503, 0.02962751054001408, 0.03156415077987386 ], [ 0.027863267575146067, 0.025971977831159183, 0.024150772386242265, 0.022401891742964194, 0.020727738260543402, 0.019130925309705102, 0.017614335891162586, 0.016181190338739892, 0.014835120247150316, 0.013580240939474629, 0.012421206204795027, 0.01136321514121005, 0.010411921233433548, 0.009573171822470857, 0.008852494771519922, 0.008254275364970117, 0.007780664661218712, 0.007430437795328275, 0.007198201470150757, 0.007074372213500596, 0.007046097083272258, 0.007098878273757263, 0.007218382579020383, 0.007391945335068759, 0.007609524250370878, 0.007864109022495782, 0.008151724301986551, 0.00847118139482595, 0.008823696149749484, 0.009212444435613499, 0.009642093841343534, 0.010118333933818544, 0.010647422973686328, 0.011235769998306371, 0.011889572139826023, 0.012614524602610607, 0.013415614113881532, 0.01429699735691711, 0.015261956518545196, 0.016312917065690376, 0.017451509496000127, 0.018678657014001055, 0.019994673844717988, 0.02139936287993675, 0.022892105422067214, 0.02447193924114678, 0.026137623704532938, 0.02788769238771288, 0.029720494491200886, 0.03163422678009299 ], [ 0.02842782813362274, 0.026542471940820135, 0.02472771760440799, 0.022985926498352034, 0.021319632936746387, 0.019731589779674756, 0.018224820135253214, 0.016802672951080313, 0.0154688771733042, 0.014227583838066167, 0.013083377092336467, 0.012041223313312805, 0.011106313558475913, 0.010283744030868004, 0.009577984526391638, 0.008992124988239468, 0.008526980300895295, 0.008180258823583786, 0.007946093524933277, 0.007815198987483011, 0.007775716574806592, 0.007814542127905154, 0.007918767382210201, 0.008076895835842845, 0.008279654311888842, 0.008520388659138201, 0.008795129168079972, 0.00910243439877169, 0.009443103159871992, 0.009819814344723858, 0.010236730087125733, 0.010699084074352808, 0.011212772224793274, 0.011783963301540289, 0.01241874825010922, 0.013122846066071073, 0.013901379524124255, 0.014758726693936651, 0.015698445683836267, 0.016723262669383065, 0.017835108552056094, 0.01903518806116307, 0.020324066289997562, 0.021701760539332256, 0.02316782886139868, 0.02472145004459233, 0.02636149249861211, 0.028086571445777805, 0.02989509505216094, 0.03178530079083562 ], [ 0.029139789425735422, 0.027262424366526455, 0.02545618714635833, 0.023723539491060576, 0.02206711664143397, 0.020489765778426317, 0.01899458637274297, 0.017584968624902116, 0.01626462286464028, 0.015037587781116812, 0.013908198442786627, 0.012880986809687932, 0.011960480232372181, 0.011150862799568721, 0.010455479543828852, 0.009876204480849443, 0.009412761973052021, 0.009062166812323209, 0.008818485254127975, 0.008673068389589646, 0.008615268029291422, 0.008633480831793614, 0.008716272020331829, 0.008853348632253713, 0.009036249508239455, 0.009258726782436015, 0.00951686428044036, 0.009809003416874906, 0.010135541891439151, 0.010498653381288013, 0.010901959975940678, 0.011350178509396661, 0.011848757555643128, 0.012403521581482961, 0.013020339758274888, 0.013704836718586234, 0.014462159664129712, 0.015296810626074233, 0.016212545489586647, 0.017212334348625933, 0.018298372413344935, 0.01947212789837, 0.020734413075185566, 0.022085466352436814, 0.023525035980007696, 0.025052458955178852, 0.0266667313901264, 0.028366568703295597, 0.030150455464208786, 0.032016685624732456 ], [ 0.029990479381614664, 0.0281224593919266, 0.026326008572922797, 0.024603655241194847, 0.0229580908014262, 0.021392198489262746, 0.019909079929446533, 0.018512074652239308, 0.017204764714975472, 0.015990952543199287, 0.014874595306782819, 0.013859674659214245, 0.012949978969880467, 0.012148780540442057, 0.011458408127691198, 0.010879748958540091, 0.01041176030978273, 0.010051111641507486, 0.009792086732911534, 0.009626829735155168, 0.009545926372737415, 0.009539212329087847, 0.009596644438626633, 0.009709078783883884, 0.009868856119970331, 0.010070162739957148, 0.010309185246803229, 0.010584101513726515, 0.010894952922411792, 0.011243435111347889, 0.01163263446320534, 0.012066730059459652, 0.012550677156413696, 0.013089887620617245, 0.013689923450553452, 0.014356219632157774, 0.01509385079130068, 0.015907352019812075, 0.01680059844959767, 0.01777674187682438, 0.018838197351741734, 0.019986669116655403, 0.02122320392018246, 0.022548260289929366, 0.023961784185419034, 0.025463283880472695, 0.027051899368783144, 0.028726463687662646, 0.030485555156729276, 0.0323275406216049 ], [ 0.030970300937620092, 0.02911227964959946, 0.027326109048614114, 0.0256143442666133, 0.023979683901572013, 0.0224249881625637, 0.02095329149407322, 0.019567804523772804, 0.018271897800670088, 0.017069056988242914, 0.015962796455532856, 0.014956516705756939, 0.014053292782923027, 0.013255588423826717, 0.012564906803541264, 0.011981413439910188, 0.011503595120830958, 0.011128038878774341, 0.010849412142346648, 0.010660690518322111, 0.010553620436504627, 0.010519343483303713, 0.010549073900154294, 0.010634722678401671, 0.010769393234094107, 0.010947715640301784, 0.0111660215695802, 0.011422382582210894, 0.011716541095203129, 0.012049761454755892, 0.012424623402403533, 0.012844775520147662, 0.013314663563418195, 0.013839247949213823, 0.014423725110550923, 0.015073267664446652, 0.015792797266464157, 0.016586801120994487, 0.017459198598174387, 0.01841325909936649, 0.019451567290356603, 0.02057602801375295, 0.021787901099245305, 0.023087855915711587, 0.024476036480764043, 0.025952129720477043, 0.027515431531039507, 0.029164907245641164, 0.030899244728880868, 0.03271689952631591 ], [ 0.03206925599623082, 0.030221256901813993, 0.02844518094435071, 0.02674357128264376, 0.025119088900874227, 0.023574520709469263, 0.022112779911311168, 0.020736893776738752, 0.01944997230776297, 0.018255149617237468, 0.017155488741117057, 0.016153840982591948, 0.015252654105652802, 0.014453731231299349, 0.013757954977219563, 0.013165008147011943, 0.012673138894177946, 0.012279027439649424, 0.011977805335711295, 0.011763253662210428, 0.011628168797300432, 0.011564846756841442, 0.011565613874619312, 0.011623330061538732, 0.011731807955698111, 0.0118861170193622, 0.012082765785885937, 0.012319771996831994, 0.012596638293527885, 0.012914252640290785, 0.01327473090269073, 0.013681216582073004, 0.01413765108858166, 0.014648527499027023, 0.015218641073273358, 0.015852850070206585, 0.016555859777947813, 0.017332040643264192, 0.018185287954479795, 0.01911892620126949, 0.02013565680163206, 0.02123754415302931, 0.022426032483246455, 0.023701984927599846, 0.02506573648217269, 0.026517153606142027, 0.028055694838163607, 0.029680468479695847, 0.0313902849246402, 0.03318370244565701 ], [ 0.033277382132223775, 0.0314389095461854, 0.02967220095238815, 0.027979754786686, 0.02636415910936666, 0.02482809121007662, 0.02337430838605058, 0.022005625698302996, 0.02072487548926468, 0.0195348426744739, 0.01843816975793305, 0.01743722684047862, 0.01653394540665512, 0.015729621066555212, 0.015024699728201432, 0.014418572601886979, 0.013909414961370567, 0.013494107341973594, 0.013168271823375845, 0.012926439092999785, 0.012762337667788904, 0.012669272506189513, 0.012640544352141637, 0.012669858059934945, 0.01275167692515091, 0.012881495620929198, 0.013056020665116718, 0.013273260129583643, 0.013532531986467027, 0.013834403695402724, 0.01418057603221317, 0.014573723439910789, 0.015017302521601782, 0.015515340180150227, 0.016072213236779483, 0.01669243164651532, 0.01738043708714831, 0.01814042729668066, 0.018976213973401233, 0.019891118613002603, 0.02088790689684027, 0.021968758809528068, 0.02313526907601494, 0.024388471039410636, 0.025728876744947997, 0.027156526532796512, 0.028671042551054918, 0.03027168195690124, 0.03195738692186261, 0.03372682973321379 ], [ 0.03458508396953272, 0.032755250835136945, 0.030996791163295748, 0.02931213456330912, 0.02770377245752317, 0.0261742511850593, 0.024726156092338736, 0.023362083212352582, 0.022084594606434062, 0.02089615325750713, 0.019799033906767065, 0.018795207854912753, 0.01788620294617331, 0.01707294496131197, 0.01635559319675851, 0.015733390006876933, 0.015204549508202112, 0.014766211918498504, 0.014414485022777009, 0.01414458267920856, 0.013951054333654287, 0.013828083561520918, 0.013769822418703188, 0.013770724808087654, 0.013825846161636814, 0.01393108598307228, 0.014083360677591156, 0.014280703677808112, 0.014522296638315352, 0.014808439291936737, 0.015140467186479236, 0.015520626967868044, 0.015951918985140607, 0.01643791722320068, 0.01698257697158923, 0.017590040957141867, 0.01826445451815151, 0.01900979944315644, 0.01982975420906236, 0.020727585672300722, 0.021706074169072845, 0.022767470956429895, 0.023913484429778566, 0.025145289881640415, 0.026463556810825024, 0.027868487852236803, 0.029359864058714373, 0.030937092270059453, 0.03259925142018981, 0.0343451356896483 ], [ 0.03598336077849472, 0.03416101519539833, 0.03240943796548146, 0.03073097493010652, 0.02912800840110476, 0.027602945767342027, 0.026158199518095938, 0.024796156061374586, 0.023519130521999967, 0.02232930485952358, 0.021228647385874367, 0.020218813354850235, 0.019301028955488693, 0.01847596480158013, 0.01774360954388224, 0.017103158712102325, 0.0165529370029412, 0.016090372447163045, 0.015712037071597646, 0.015413760742528444, 0.015190814209544809, 0.015038146535332933, 0.014950653939742112, 0.01492345357501818, 0.01495213724666076, 0.01503298541818063, 0.015163128978509535, 0.015340653263720794, 0.01556464444592472, 0.015835182208308294, 0.016153284843168705, 0.016520814079949004, 0.016940347622180763, 0.01741502790950811, 0.01794839613304064, 0.018544220903155283, 0.019206330957835128, 0.019938460666078562, 0.02074411570288005, 0.02162646421122603, 0.022588256268397847, 0.02363177189744817, 0.02475879558089145, 0.02597061352600613, 0.027268028938035444, 0.028651390266097476, 0.030120627668644803, 0.03167529361321882, 0.033314604386675314, 0.03503748018631947 ], [ 0.03746394383330951, 0.03564778289246923, 0.03390159771387519, 0.03222764371731365, 0.030628191103726613, 0.02910551071422563, 0.027661852085302828, 0.0262994117498773, 0.025020289845638678, 0.023826433412545617, 0.02271956554616289, 0.02170110097494507, 0.020772050740018595, 0.019932921421680908, 0.019183617485115132, 0.018523358216379123, 0.01795062253769122, 0.01746313480999745, 0.017057901904913575, 0.016731306352313537, 0.01647925308472982, 0.01629735975257683, 0.016181174538686848, 0.01612640219866936, 0.01612911915239605, 0.016185961359703106, 0.016294273308944514, 0.016452211477450556, 0.016658800118902937, 0.016913940702139186, 0.0172183787225636, 0.017573633165065987, 0.0179818949362411, 0.018445901359651948, 0.01896879445147341, 0.01955397112586062, 0.020204933577562877, 0.020925147691467333, 0.02171791633536902, 0.022586272825643683, 0.023532897872245613, 0.024560061167004914, 0.025669586767035974, 0.0268628397920521, 0.028140730854521588, 0.029503734115173538, 0.030951914842344216, 0.03248496272742885, 0.034102227821420694, 0.035802756669730096 ], [ 0.03901936221009068, 0.03720802750854664, 0.035465720552592804, 0.03379460639836481, 0.03219684729922056, 0.03067458720099989, 0.029229929358861928, 0.027864905664188474, 0.026581436393205128, 0.025381279466920127, 0.02426596904357081, 0.023236744433237616, 0.02229447195757499, 0.02143956439811287, 0.020671904849236387, 0.019990783703111126, 0.019394858589625898, 0.01888214680548348, 0.01845005770768258, 0.01809546872300963, 0.017814843550358263, 0.01760438575646931, 0.01746021640901445, 0.017378561584650048, 0.017355934973381646, 0.017389302231868842, 0.01747621661740284, 0.01761491897448284, 0.01780439864214382, 0.018044414846777008, 0.018335480472682072, 0.018678811809875635, 0.01907624912250612, 0.0195301538179563, 0.020043288714117535, 0.020618688394329, 0.02125952682755914, 0.02196898921083012, 0.02275015428898856, 0.023605892228616136, 0.024538781568233088, 0.02555104701760134, 0.0266445181546936, 0.027820607576642765, 0.029080305950330697, 0.030424190745973072, 0.031852445210599586, 0.03336488427270907, 0.034960984457650314, 0.03663991542325597 ], [ 0.040642956048952045, 0.038835109429403915, 0.03709522017123355, 0.03542536797202664, 0.03382761618833894, 0.032303995977022146, 0.03085648449485098, 0.029486976155842736, 0.028197246118722038, 0.026988905552573928, 0.025863348868199774, 0.024821694048174945, 0.023864718459417945, 0.022992794011761228, 0.02220582705504558, 0.021503209699321655, 0.020883789930665666, 0.020345867615913008, 0.01988722199893308, 0.01950517358901178, 0.01919667974137679, 0.01895845932420822, 0.01878713838493023, 0.01867940632338919, 0.018632171135768164, 0.01864270283448395, 0.018708755879995823, 0.01882866390154102, 0.019001402641238452, 0.019226619551001686, 0.01950463059499249, 0.01983638651017012, 0.020223412100917305, 0.020667723169400038, 0.021171726465227234, 0.021738108581550064, 0.02236971998649809, 0.023069460294796274, 0.023840170405241688, 0.024684536254872318, 0.02560500773561783, 0.02660373491129227, 0.02768252222601634, 0.02884280007597706, 0.030085612057784192, 0.031411615486623704, 0.03282109241197878, 0.03431396831150747, 0.03588983584299931, 0.03754798139577842 ], [ 0.042328853971731736, 0.040523234599467294, 0.038784411288718325, 0.03711438668855368, 0.035515137247676645, 0.033988597683687526, 0.03253664038169422, 0.031161049023266923, 0.02986348593332224, 0.028645452977159598, 0.02750824637872031, 0.026452906585537582, 0.02548016526207615, 0.024590392585596355, 0.023783549114644184, 0.02305914739855168, 0.022416228950997496, 0.02185336198031529, 0.021368664192370903, 0.020959853049069763, 0.020624323268208785, 0.02035924846446219, 0.020161701139958476, 0.020028783199465144, 0.019957758108458536, 0.01994617583083379, 0.019991982652241107, 0.020093609636549395, 0.02025003544251971, 0.0204608212485853, 0.020726117391943574, 0.02104664292426625, 0.021423640600258007, 0.021858810868523627, 0.022354229250085067, 0.022912252070056347, 0.023535415829084562, 0.02422633552300801, 0.024987606912214164, 0.025821717104304198, 0.026730966890612513, 0.027717407157663902, 0.02878279050082296, 0.029928538029633987, 0.031155720385202926, 0.03246505126756928, 0.033856891327350064, 0.03533126010035135, 0.03688785371414475, 0.03852606631056586 ], [ 0.04407192796167181, 0.04226739315338389, 0.040528430532588616, 0.038856975942219894, 0.0372549323279897, 0.035724154956273825, 0.03426643232999091, 0.03288346231877546, 0.03157682320029838, 0.03034793961191678, 0.02919804385778933, 0.028128133614971046, 0.027138927816174354, 0.026230823303882392, 0.025403855651678863, 0.02465766819318981, 0.023991493616412538, 0.023404152307463184, 0.022894070849198145, 0.022459322682204453, 0.022097691033828293, 0.021806752056775354, 0.02158397401779071, 0.021426826670982415, 0.021332893897213993, 0.021299982414084796, 0.021326219831715437, 0.021410136396408375, 0.021550726209014923, 0.02174748530570311, 0.022000425566827367, 0.02231006485939484, 0.022677395064014137, 0.023103830671163245, 0.023591141451828394, 0.02414137330884895, 0.024756761779954464, 0.025439642768639924, 0.026192364904989777, 0.027017207487333394, 0.027916307257605744, 0.028891596384098744, 0.029944753053680963, 0.03107716511263922, 0.032289906334391175, 0.03358372420397323, 0.03495903763332311, 0.03641594276344159, 0.03795422494850309, 0.03957337511249881 ], [ 0.045867735577695176, 0.044063288240852636, 0.04232315117853133, 0.04064920453902725, 0.03904329147983158, 0.0375072043604354, 0.03604266728861992, 0.03465131468670845, 0.03333466570977978, 0.03209409460649978, 0.030930797478872476, 0.029845756372426945, 0.028839702196673454, 0.02791307859555337, 0.027066009486682703, 0.026298273464738925, 0.02560928849936678, 0.024998110235040123, 0.024463446637124783, 0.024003690706773703, 0.023616971576172836, 0.02330122265205057, 0.023054263820780345, 0.02287389330355418, 0.022757983759633275, 0.022704576804273305, 0.022711970257397854, 0.02277879309758385, 0.022904064126450453, 0.023087231592038706, 0.02332819232834333, 0.02362729022935566, 0.023985295017252207, 0.0244033632455729, 0.02488298427881738, 0.02542591459527766, 0.02603410415493148, 0.026709618742283708, 0.02745456212428538, 0.028271001558212702, 0.029160899666870795, 0.030126055016369464, 0.031168052950770558, 0.0322882274360205, 0.033487633917466425, 0.034767032563365996, 0.036126880790970636, 0.03756733366846455, 0.039088250647401866, 0.040689207083338105 ], [ 0.04771245639719928, 0.04590726187424013, 0.04416509824594672, 0.04248780117278005, 0.040877167296572495, 0.039334941497983694, 0.037862801053361685, 0.03646233646073893, 0.035135028851340476, 0.03388222412161255, 0.03270510421996161, 0.03160465640140253, 0.03058164170810138, 0.029636564412109153, 0.02876964461413641, 0.027980796555779088, 0.027269615385925837, 0.026635375041133454, 0.02607703949216648, 0.025593288855672282, 0.025182560810696815, 0.02484310649740353, 0.02457305876245786, 0.024370509427755215, 0.024233591357956292, 0.024160560602313082, 0.024149873833971904, 0.024200256681071293, 0.02431075925879262, 0.024480796158793228, 0.024710169216436324, 0.02499907245582577, 0.02534807963186951, 0.025758115695494337, 0.026230414270529228, 0.026766463825743828, 0.027367945637626918, 0.028036666854173217, 0.028774491980886253, 0.029583275919825888, 0.030464801319167498, 0.0314207224693351, 0.032452517361991555, 0.03356144886924679, 0.03474853536232655, 0.03601453052405526, 0.03735991165592839, 0.03878487545894911, 0.04028934007991675, 0.04187295214980823 ], [ 0.04960282722790556, 0.04779622201950454, 0.04605136763783157, 0.04437006602721731, 0.04275407966915737, 0.04120511990312172, 0.03972483259431207, 0.03831478098780905, 0.036976425716403256, 0.035711102113018665, 0.03451999522392209, 0.03340411322368522, 0.03236426028519916, 0.03140101033342285, 0.030514683468655972, 0.029705327130649724, 0.02897270422439461, 0.028316290380454075, 0.02773528222803663, 0.027228617999519505, 0.02679501098179788, 0.026432995350748816, 0.02614098287602609, 0.025917327993807138, 0.025760397941200473, 0.02566864412902694, 0.025640670755124616, 0.02567529683227572, 0.025771608281575927, 0.025928997449162338, 0.0261471882539828, 0.026426246081140446, 0.02676657242691829, 0.027168885122443805, 0.02763418567368387, 0.028163715828811556, 0.028758905900844168, 0.029421317621122656, 0.030152584371641648, 0.030954351544124282, 0.03182821951525061, 0.03277569133658935, 0.033798126752663075, 0.03489670362603266, 0.03607238731220945, 0.03732590803281758, 0.03865774587728693, 0.04006812274299882, 0.04155700030991682, 0.0431240830337516 ], [ 0.05153607889041474, 0.04972757331754625, 0.04797955114593131, 0.04629379060073093, 0.04467203117039202, 0.04311596293257458, 0.04162721358990635, 0.04020733310151006, 0.038857775906582674, 0.03757988089067305, 0.0363748494472007, 0.03524372223431713, 0.03418735551007317, 0.03320639822836168, 0.03230127136297868, 0.03147215115696593, 0.03071895812126428, 0.030041353583423115, 0.029438745375255013, 0.028910303829752588, 0.02845498864323968, 0.028071586392424484, 0.027758757652575503, 0.027515091837587255, 0.02733916717491373, 0.027229612723639395, 0.02718516910006757, 0.027204744611181293, 0.027287463795689634, 0.027432705887646472, 0.02764013138481876, 0.027909695653286146, 0.028241649266556163, 0.02863652550745306, 0.029095116112435114, 0.029618436880470212, 0.030207685180569536, 0.030864191660600917, 0.03158936857850605, 0.03238465714720252, 0.03325147611731048, 0.03419117353676332, 0.03520498325269169, 0.03629398729302563, 0.0374590848210857, 0.03870096793112584, 0.040020104176885646, 0.04141672541949998, 0.04289082235708947, 0.04444214395749288 ], [ 0.05350987615478926, 0.05169915260289762, 0.049947667970646877, 0.04825718578881462, 0.046629432404779826, 0.04506608722278094, 0.04356877094601094, 0.04213903173720522, 0.04077832930919697, 0.0394880170870681, 0.03826932275102222, 0.037123327672171455, 0.03605094598390118, 0.035052904274350774, 0.034129723117377074, 0.033281701848569566, 0.032508908103817256, 0.03181117363284873, 0.031188097748903246, 0.03063905946131743, 0.03016323886397658, 0.0297596477482066, 0.029427168726339298, 0.029164601462576566, 0.028970713989146947, 0.028844296609695046, 0.028784215612999105, 0.028789463965512897, 0.02885920631973662, 0.028992816039814535, 0.029189902460279197, 0.029450327203839718, 0.029774209034063203, 0.030161917358433637, 0.030614055085795785, 0.031131432047262365, 0.031715030589154, 0.03236596522579968, 0.03308543839156371, 0.03387469435600215, 0.03473497327092097, 0.035667467118466044, 0.03667327904745838, 0.03775338724755324, 0.03890861414749916, 0.04013960136352897, 0.04144679049251768, 0.04283040956159136, 0.04429046472384032, 0.045826736633572965 ], [ 0.05552226160239715, 0.053709169617981, 0.05195410271894122, 0.050258817698152686, 0.04862503626781664, 0.047054436107177466, 0.045548640146132996, 0.04410920402132868, 0.04273760172306304, 0.04143520956145861, 0.04020328872078242, 0.03904296683916312, 0.037955219241389365, 0.03694085065275237, 0.03600047841371885, 0.035134518374789474, 0.034343174749209296, 0.033626435209789626, 0.03298407240944935, 0.03241565286791023, 0.031920553799186076, 0.03149798797405422, 0.031147036156687794, 0.030866686076794107, 0.030655876360449405, 0.03051354340302347, 0.030438668876135003, 0.03043032544733486, 0.030487718364809572, 0.030610220806199677, 0.030797401279722185, 0.03104904185530742, 0.03136514654720937, 0.0317459397233221, 0.03219185494107067, 0.032703515074286295, 0.03328170497614389, 0.03392733820507474, 0.03464141951481045, 0.0354250048749444, 0.03627916075013926, 0.03720492423469798, 0.03820326543272895, 0.03927505321212931, 0.04042102516757896, 0.04164176232674866, 0.04293766884661791, 0.04430895669100913, 0.04575563506842724, 0.04727750424807953 ], [ 0.057571603670292903, 0.05575615286811916, 0.053997549478014356, 0.052297550416726596, 0.05065787995184281, 0.0490802214452062, 0.04756620751938663, 0.04611740859672969, 0.0447353198312367, 0.04342134654737401, 0.0421767884187623, 0.04100282276116897, 0.03990048747351214, 0.0388706643285077, 0.03791406347601367, 0.037031210158750834, 0.03622243472906464, 0.0354878670733202, 0.034827436476907926, 0.03424087778349024, 0.03372774441473831, 0.03328742843230105, 0.032919187369218755, 0.03262217707289016, 0.032395489333932, 0.0322381926746876, 0.03214937438100706, 0.0321281817116068, 0.032173860225071904, 0.03228578732093968, 0.032463499378621745, 0.03270671126519991, 0.03301532743282683, 0.03338944430045929, 0.033829344077631336, 0.03433548061003307, 0.03490845818458545, 0.03554900450960974, 0.036257939273634035, 0.03703613978188185, 0.037884505174910446, 0.03880392065726082, 0.039795223018422726, 0.04085916852990447, 0.04199640406914181, 0.043207442073013975, 0.0444926396781723, 0.04585218217857462, 0.04728607073370496, 0.048794114102047176 ], [ 0.05965654883079173, 0.057838900320475825, 0.05607696140130336, 0.05437249490028712, 0.05272723358356833, 0.051142872485839576, 0.049621059812481556, 0.04816338637252006, 0.04677137356171684, 0.04544645999609681, 0.044189986997810723, 0.043003183255337175, 0.04188714911546998, 0.04084284110701692, 0.03987105743424879, 0.0389724252968783, 0.03814739097459654, 0.03739621363869997, 0.036718963803889754, 0.03611552719785114, 0.03558561459980822, 0.03512877788974575, 0.03474443217540932, 0.03443188345508188, 0.034190360868136, 0.0340190522232684, 0.03391714121402633, 0.033883844561836525, 0.033918447284729224, 0.03402033437785498, 0.034189017397652136, 0.0344241547431744, 0.034725564796032005, 0.03509323148220519, 0.035527302223675346, 0.03602807862769264, 0.036596000593801095, 0.03723162478779523, 0.03793559862665455, 0.03870863103504341, 0.03955146127278436, 0.04046482709928613, 0.04144943344491398, 0.0425059226128558, 0.04363484685345465, 0.04483664395112447, 0.046111616257312193, 0.04745991340472976, 0.04888151875933545, 0.05037623951493379 ], [ 0.061775977695573754, 0.05995643454331128, 0.05819150520395339, 0.05648296317378427, 0.05483255450152417, 0.053241990600280106, 0.05171293975239884, 0.05024701727084864, 0.048845774334456825, 0.04751068558477986, 0.046243135660166614, 0.04504440494587854, 0.043915654935812454, 0.04285791372364311, 0.04187206226135764, 0.04095882212741568, 0.040118745621495235, 0.03935220903155434, 0.03865940988753308, 0.038040368913186316, 0.03749493720852642, 0.03702280894396949, 0.036623539536964955, 0.03629656893517779, 0.0360412492775998, 0.035856875879317324, 0.035742720220203694, 0.035698063438922255, 0.03572222875951393, 0.03581461131396674, 0.0359747039657851, 0.03620211797037741, 0.03649659760590162, 0.03685802824595563, 0.03728643769639918, 0.03778199095742004, 0.038344978877540986, 0.038975801422688826, 0.03967494647966583, 0.04044296524376084, 0.04128044530388009, 0.0421879825388159, 0.0431661528818718, 0.04421548490785488, 0.04533643405766353, 0.04652935915443021, 0.047794501693153156, 0.04913196821532576, 0.05054171592038519, 0.05202354152491944 ], [ 0.06392896476175886, 0.06210796185767325, 0.060340519994937156, 0.05862842713542727, 0.05697344633273535, 0.05537730893198076, 0.05384170655942491, 0.05236828186947792, 0.050958618064111165, 0.04961422726172944, 0.04833653786897282, 0.04712688119936857, 0.04598647768374641, 0.04491642312444311, 0.04391767555023865, 0.042991043322061384, 0.04213717520827582, 0.04135655317970751, 0.040649488656292296, 0.040016122859257076, 0.039456431780005366, 0.03897023607143051, 0.03855721590827945, 0.038216930568283645, 0.03794884217835397, 0.03775234277857176, 0.03762678360807366, 0.03757150533646222, 0.03758586786894501, 0.037669278351949845, 0.03782121609684224, 0.03804125331278526, 0.03832907077813168, 0.03868446786135618, 0.039107366604739485, 0.03959780988402051, 0.04015595393557053, 0.0407820557843084, 0.041476456298490935, 0.04223955973621935, 0.043071810729732055, 0.043973669679700095, 0.044945587506799445, 0.045987980639729274, 0.047101207016164985, 0.04828554374626446, 0.04954116694756052, 0.050868134115211856, 0.05226636925126178, 0.05373565084808451 ], [ 0.06611474150153826, 0.06429283509645486, 0.06252347993766065, 0.06080848135953284, 0.05914962218092004, 0.05754865620791116, 0.05600730060536927, 0.054527227107760826, 0.05311005208233577, 0.051757325512709944, 0.05047051903854262, 0.049251013266506605, 0.04810008465682945, 0.04701889238392241, 0.04600846566266483, 0.04506969211540469, 0.044203307818197125, 0.043409889697622134, 0.04268985094051695, 0.04204344001974018, 0.04147074382455777, 0.04097169521486827, 0.04054608510061182, 0.04019357889551354, 0.03991373692573655, 0.03970603811305114, 0.039569906021655624, 0.039504736180344786, 0.039509923483586604, 0.039584888446307906, 0.03972910113924342, 0.039942101758540266, 0.04022351697185582, 0.04057307141667229, 0.040990593984781734, 0.041476018791025075, 0.04202938097613226, 0.04265080771838106, 0.04334050501584609, 0.04409874094275903, 0.044925826177123644, 0.04582209264191929, 0.046787871102183666, 0.0478234685203975, 0.04892914589988304, 0.05010509724841068, 0.05135143018071203, 0.05266814855711032, 0.05405513743395543, 0.05551215048617596 ], [ 0.0683326625138878, 0.06651051961233385, 0.06473996030885908, 0.06302280940449323, 0.06136087137957287, 0.05975592412491955, 0.05820971160678828, 0.0567239354388685, 0.0553002453729129, 0.053940228768946615, 0.052645399166418555, 0.051417184148450784, 0.050256912770532014, 0.04916580290886407, 0.04814494896668684, 0.04719531045228427, 0.046317702001161386, 0.04551278544771582, 0.0447810645496445, 0.044122882922963874, 0.04353842565308003, 0.04302772490601448, 0.04259066968005192, 0.042227019620361225, 0.04193642258433605, 0.04171843541157542, 0.04157254714015106, 0.041498203739616, 0.04149483331647126, 0.04156187070003353, 0.04169878033896619, 0.04190507652857624, 0.042180340136399645, 0.042524231185467484, 0.042936496874577894, 0.04341697484589215, 0.043965591736345594, 0.04458235725705953, 0.045267354223322884, 0.04602072509942353, 0.04684265572354765, 0.047733356937232706, 0.04869304486282016, 0.049721920555216015, 0.05082014970602975, 0.05198784300557896, 0.053225037678302216, 0.05453168060676985, 0.055907613355369395, 0.05735255930295639 ], [ 0.07058217449008769, 0.06876056223220277, 0.06698960660487334, 0.06527115323372631, 0.06360702938627111, 0.06199903786694964, 0.060448949900559094, 0.05895849697993568, 0.057529361688725196, 0.05616316755486446, 0.0548614680448181, 0.053625734872342116, 0.052457345866514106, 0.05135757271901582, 0.05032756900549641, 0.04936835894408931, 0.048480827408554236, 0.04766571174587965, 0.0469235959503763, 0.046254907711877895, 0.04565991877961293, 0.04513874896506528, 0.044691373949958986, 0.04431763687709365, 0.04401726349539133, 0.043789880420935526, 0.043635035881137194, 0.04355222214625579, 0.04354089873551531, 0.04360051542444647, 0.04373053408054128, 0.04393044841458521, 0.04419980084878218, 0.044538195859714455, 0.04494530934015026, 0.04542089372511063, 0.04596477882952407, 0.04657686853510722, 0.047257133632398064, 0.048005601262655795, 0.04882234150907302, 0.04970745175559332, 0.050661039465117415, 0.051683204029373514, 0.05277401831477354, 0.053933510476528244, 0.05516164654383386, 0.05645831419712747, 0.05782330807057858, 0.059256316824042844 ], [ 0.07286278778441985, 0.07104256291218256, 0.06927210641728632, 0.06755328544637199, 0.06588795049735775, 0.064277929423558, 0.06272502047302858, 0.06123098434177661, 0.059797535251605916, 0.05842633110450135, 0.057118962814888576, 0.05587694297896745, 0.05470169410434623, 0.0535945366912804, 0.05255667752448098, 0.05158919859648262, 0.050693047133821896, 0.049869027228388, 0.04911779358152371, 0.048439847841835484, 0.047835537954558735, 0.04730506084027435, 0.04684846858521135, 0.046465678161698394, 0.04615648451467259, 0.045920576662581626, 0.04575755628294287, 0.04566695809916462, 0.045648271269356645, 0.045700960909195475, 0.04582448886530016, 0.04601833289287514, 0.046282003477959466, 0.04661505767163917, 0.04701710946080203, 0.047487836374359965, 0.04802698220361965, 0.04863435588847067, 0.049309826778448515, 0.05005331661153105, 0.050864788659135296, 0.051744234560848354, 0.052691659416292516, 0.053707065716064845, 0.054790436681625844, 0.05594171954938799, 0.05716080928197689, 0.058447533124232155, 0.05980163634825645, 0.06122276945524908 ], [ 0.07517405042110761, 0.07335614889904712, 0.07158716386344213, 0.06986898408844273, 0.06820348314542782, 0.06659251347063831, 0.06503789950920971, 0.0635414299172011, 0.06210484883329426, 0.06072984626948626, 0.05941804771578421, 0.0581710031064138, 0.0569901753536069, 0.05587692871664181, 0.05483251733533799, 0.05385807431366367, 0.05295460178542547, 0.05212296242338247, 0.051363872860186795, 0.05067789946854106, 0.0500654568949775, 0.04952680965591298, 0.04906207698711538, 0.04867124099403523, 0.04835415798897078, 0.04811057273222335, 0.047940135132232206, 0.04784241881570624, 0.047816940866159785, 0.04786318195630505, 0.04798060607261728, 0.04816867905016954, 0.04842688520027698, 0.048754741416000294, 0.04915180827246021, 0.04961769778988559, 0.05015207768610528, 0.05075467210209494, 0.05142525892979507, 0.052163663998924345, 0.05296975248393473, 0.05384341797049588, 0.05478456967222719, 0.055793118313379124, 0.05686896119393321, 0.058011966933106306, 0.05922196034954542, 0.06049870788530786, 0.061841903920554574, 0.06325115826066943 ], [ 0.07751552440452449, 0.0757009512486052, 0.07393447640989086, 0.07221800987451106, 0.0705534476067496, 0.06894266564299337, 0.06738751329939062, 0.06588980547805602, 0.06445131408486234, 0.0630737586070304, 0.061758795940685014, 0.060508009606976734, 0.059322898548807054, 0.058204865756348326, 0.057155207025623864, 0.05617510020583717, 0.05526559533344231, 0.05442760607867631, 0.05366190293787051, 0.05296910858796777, 0.05234969577455988, 0.05180398803043315, 0.05133216341875671, 0.050934261368552995, 0.0506101925261016, 0.05035975139460725, 0.05018263138621706, 0.05007844177694527, 0.05004672594691383, 0.05008698021381071, 0.05019867253253754, 0.05038126034050337, 0.05063420687488242, 0.050956995370103696, 0.051349140654506506, 0.051810197794967004, 0.05233976757860639, 0.05293749876178516, 0.053603087150700446, 0.05433627169814953, 0.05513682790232662, 0.05600455887312326, 0.056939284487336345, 0.05794082908697039, 0.05900900818557688, 0.06014361463861745, 0.061344404708259644, 0.06261108441410207, 0.06394329651269125, 0.06534060839385186 ], [ 0.0798867642301876, 0.07807658358787836, 0.07631371396815857, 0.07460008569583733, 0.07293761599479055, 0.07132820307889677, 0.06977371939135829, 0.0682760039808005, 0.06683685402918321, 0.06545801557946483, 0.0641411735499266, 0.06288794116673066, 0.06169984899536541, 0.06057833380297316, 0.059524727534595284, 0.058540246733248875, 0.057625982772337984, 0.056782893294388175, 0.05601179525792342, 0.05531335998009216, 0.05468811052371357, 0.054136421712098766, 0.053658522964665875, 0.05325450403377041, 0.05292432359495729, 0.05266782050646179, 0.05248472741879392, 0.052374686291807256, 0.05233726527392105, 0.05237197632419148, 0.0524782929179666, 0.05265566717356054, 0.05290354577019378, 0.05322138409264162, 0.05360865813048702, 0.05406487377143345, 0.05458957325156998, 0.05518233865201106, 0.05584279245403776, 0.05657059527719227, 0.05736544102207006, 0.05822704971846809, 0.0591551584382475, 0.0601495106705136, 0.061209844575106684, 0.06233588053062576, 0.06352730837777702, 0.06478377473027207, 0.06610487068701856, 0.0674901202338253 ], [ 0.08228729751817694, 0.0804826230358682, 0.0787245001735631, 0.0770148783241218, 0.07535569445065513, 0.07374886715225172, 0.072196289911085, 0.07069982351324242, 0.06926128766070605, 0.06788245182295094, 0.06656502541292046, 0.0653106474135121, 0.0641208756258555, 0.06299717575770467, 0.06194091061668899, 0.06095332971591775, 0.06003555963434953, 0.05918859549751389, 0.058413293951688997, 0.05771036799216628, 0.05708038397213143, 0.05652376106079376, 0.056040773338958405, 0.05563155462025187, 0.05529610597101007, 0.05503430577895066, 0.054845922098130634, 0.054730626883702886, 0.054688011633529064, 0.05471760388145831, 0.05481888394447314, 0.05499130131534848, 0.05523429011441824, 0.05554728306548003, 0.05592972353779616, 0.05638107529201517, 0.05690082967587582, 0.057488510128885104, 0.05814367396658309, 0.0588659115194784, 0.059654842793886054, 0.060510111899043775, 0.06143137954466026, 0.06241831395486832, 0.063470580568621, 0.06458783090411561, 0.06576969095757841, 0.06701574948702559, 0.06832554650183348, 0.0696985622418535 ] ] }, { "hoverinfo": "text", "legendgroup": "In-sample", "marker": { "color": "black", "opacity": 0.5, "symbol": 1 }, "mode": "markers", "name": "In-sample", "text": [ "Arm 0_0
l2norm: 0.853643 (SEM: 0)
x1: 0.454046
x2: 0.108311
x3: 0.480222
x4: 0.387449
x5: 0.357594
x6: 0.047044", "Arm 10_0
l2norm: 1.39229 (SEM: 0)
x1: 0.737759
x2: 0.00708171
x3: 0.786064
x4: 0.306296
x5: 0.190556
x6: 0.803802", "Arm 11_0
l2norm: 1.51654 (SEM: 0)
x1: 0.00499463
x2: 0.85038
x3: 0.282013
x4: 0.881654
x5: 0.845222
x6: 0.0740822", "Arm 12_0
l2norm: 1.16979 (SEM: 0)
x1: 0.666759
x2: 0
x3: 0.609346
x4: 0.263247
x5: 0.142119
x6: 0.680478", "Arm 13_0
l2norm: 1.02741 (SEM: 0)
x1: 0.41096
x2: 0.240627
x3: 0.582696
x4: 0.235564
x5: 0.0381626
x6: 0.657492", "Arm 14_0
l2norm: 1.15911 (SEM: 0)
x1: 0.739039
x2: 1.48277e-15
x3: 0.644439
x4: 0.193962
x5: 0.108279
x6: 0.576811", "Arm 15_0
l2norm: 1.15089 (SEM: 0)
x1: 0.543757
x2: 0
x3: 0.681759
x4: 0.205896
x5: 0.00162548
x6: 0.722285", "Arm 16_0
l2norm: 1.03423 (SEM: 0)
x1: 0.500097
x2: 0.267751
x3: 0.526442
x4: 0.265153
x5: 0.131498
x6: 0.618959", "Arm 17_0
l2norm: 1.09296 (SEM: 0)
x1: 0.439871
x2: 0.414979
x3: 0.475938
x4: 0.281682
x5: 0.161137
x6: 0.705005", "Arm 18_0
l2norm: 1.13017 (SEM: 0)
x1: 0.447995
x2: 0.556936
x3: 0.414816
x4: 0.0344008
x5: 0.172525
x6: 0.750583", "Arm 19_0
l2norm: 1.07716 (SEM: 0)
x1: 0.448578
x2: 0.670713
x3: 0.234594
x4: 0.317399
x5: 0.144899
x6: 0.576569", "Arm 1_0
l2norm: 1.99632 (SEM: 0)
x1: 0.787701
x2: 0.765017
x3: 0.983973
x4: 0.800578
x5: 0.69976
x6: 0.825102", "Arm 20_0
l2norm: 1.14304 (SEM: 0)
x1: 0.407511
x2: 0.352
x3: 0.556047
x4: 0.306292
x5: 0.182656
x6: 0.761713", "Arm 21_0
l2norm: 1.20073 (SEM: 0)
x1: 0.363382
x2: 0.256764
x3: 0.648063
x4: 0.334966
x5: 0.206714
x6: 0.817846", "Arm 22_0
l2norm: 1.10088 (SEM: 0)
x1: 0.330941
x2: 0.187409
x3: 0.414243
x4: 0.36021
x5: 0.226291
x6: 0.84542", "Arm 23_0
l2norm: 1.22808 (SEM: 0)
x1: 0.34987
x2: 0.246853
x3: 0.513527
x4: 0.421378
x5: 0.188439
x6: 0.920897", "Arm 2_0
l2norm: 1.23998 (SEM: 0)
x1: 0.599525
x2: 0.498112
x3: 0.0586652
x4: 0.243652
x5: 0.752892
x6: 0.548049", "Arm 3_0
l2norm: 1.10127 (SEM: 0)
x1: 0.144057
x2: 0.655855
x3: 0.554914
x4: 0.568398
x5: 0.156581
x6: 0.326143", "Arm 4_0
l2norm: 1.11581 (SEM: 0)
x1: 0.0731118
x2: 0.294861
x3: 0.818363
x4: 0.644828
x5: 0.124673
x6: 0.227329", "Arm 5_0
l2norm: 1.62246 (SEM: 0)
x1: 0.684294
x2: 0.574683
x3: 0.314609
x4: 0.0422076
x5: 0.965861
x6: 0.894543", "Arm 6_0
l2norm: 1.78533 (SEM: 0)
x1: 0.999776
x2: 0.184601
x3: 0.642261
x4: 0.970265
x5: 0.518987
x6: 0.72836", "Arm 7_0
l2norm: 1.21408 (SEM: 0)
x1: 0.259457
x2: 0.965338
x3: 0.146016
x4: 0.342746
x5: 0.423651
x6: 0.395618", "Arm 8_0
l2norm: 1.16309 (SEM: 0)
x1: 0.318785
x2: 0.398165
x3: 0.737564
x4: 0.0746043
x5: 0.671853
x6: 0.302765", "Arm 9_0
l2norm: 1.54847 (SEM: 0)
x1: 0.921897
x2: 0.740425
x3: 0.241616
x4: 0.737369
x5: 0.263042
x6: 0.573013" ], "type": "scatter", "x": [ 0.48022231459617615, 0.7860641842707992, 0.2820129143074155, 0.6093457832528896, 0.5826958945887194, 0.644439499398482, 0.6817590308173282, 0.5264415604704081, 0.4759381777970646, 0.41481598700047884, 0.2345937784502794, 0.9839729340746999, 0.556047102066136, 0.6480627161529454, 0.41424281118440154, 0.5135274515719934, 0.05866516847163439, 0.5549135943874717, 0.8183632176369429, 0.31460949406027794, 0.642260979861021, 0.14601565711200237, 0.737563599832356, 0.24161582347005606 ], "xaxis": "x", "y": [ 0.3874489367008209, 0.30629594065248966, 0.8816544087603688, 0.2632470597675328, 0.23556388286841093, 0.19396188032890765, 0.20589572746155044, 0.26515275439808467, 0.2816821438987053, 0.03440075213280118, 0.31739947386102607, 0.8005777131766081, 0.3062919819497732, 0.33496610505884356, 0.36021037987368987, 0.4213781486663478, 0.24365175049751997, 0.5683978386223316, 0.6448277672752738, 0.042207591235637665, 0.9702646033838391, 0.34274587221443653, 0.0746043473482132, 0.7373689478263259 ], "yaxis": "y" }, { "hoverinfo": "text", "legendgroup": "In-sample", "marker": { "color": "black", "opacity": 0.5, "symbol": 1 }, "mode": "markers", "name": "In-sample", "showlegend": false, "text": [ "Arm 0_0
l2norm: 0.853643 (SEM: 0)
x1: 0.454046
x2: 0.108311
x3: 0.480222
x4: 0.387449
x5: 0.357594
x6: 0.047044", "Arm 10_0
l2norm: 1.39229 (SEM: 0)
x1: 0.737759
x2: 0.00708171
x3: 0.786064
x4: 0.306296
x5: 0.190556
x6: 0.803802", "Arm 11_0
l2norm: 1.51654 (SEM: 0)
x1: 0.00499463
x2: 0.85038
x3: 0.282013
x4: 0.881654
x5: 0.845222
x6: 0.0740822", "Arm 12_0
l2norm: 1.16979 (SEM: 0)
x1: 0.666759
x2: 0
x3: 0.609346
x4: 0.263247
x5: 0.142119
x6: 0.680478", "Arm 13_0
l2norm: 1.02741 (SEM: 0)
x1: 0.41096
x2: 0.240627
x3: 0.582696
x4: 0.235564
x5: 0.0381626
x6: 0.657492", "Arm 14_0
l2norm: 1.15911 (SEM: 0)
x1: 0.739039
x2: 1.48277e-15
x3: 0.644439
x4: 0.193962
x5: 0.108279
x6: 0.576811", "Arm 15_0
l2norm: 1.15089 (SEM: 0)
x1: 0.543757
x2: 0
x3: 0.681759
x4: 0.205896
x5: 0.00162548
x6: 0.722285", "Arm 16_0
l2norm: 1.03423 (SEM: 0)
x1: 0.500097
x2: 0.267751
x3: 0.526442
x4: 0.265153
x5: 0.131498
x6: 0.618959", "Arm 17_0
l2norm: 1.09296 (SEM: 0)
x1: 0.439871
x2: 0.414979
x3: 0.475938
x4: 0.281682
x5: 0.161137
x6: 0.705005", "Arm 18_0
l2norm: 1.13017 (SEM: 0)
x1: 0.447995
x2: 0.556936
x3: 0.414816
x4: 0.0344008
x5: 0.172525
x6: 0.750583", "Arm 19_0
l2norm: 1.07716 (SEM: 0)
x1: 0.448578
x2: 0.670713
x3: 0.234594
x4: 0.317399
x5: 0.144899
x6: 0.576569", "Arm 1_0
l2norm: 1.99632 (SEM: 0)
x1: 0.787701
x2: 0.765017
x3: 0.983973
x4: 0.800578
x5: 0.69976
x6: 0.825102", "Arm 20_0
l2norm: 1.14304 (SEM: 0)
x1: 0.407511
x2: 0.352
x3: 0.556047
x4: 0.306292
x5: 0.182656
x6: 0.761713", "Arm 21_0
l2norm: 1.20073 (SEM: 0)
x1: 0.363382
x2: 0.256764
x3: 0.648063
x4: 0.334966
x5: 0.206714
x6: 0.817846", "Arm 22_0
l2norm: 1.10088 (SEM: 0)
x1: 0.330941
x2: 0.187409
x3: 0.414243
x4: 0.36021
x5: 0.226291
x6: 0.84542", "Arm 23_0
l2norm: 1.22808 (SEM: 0)
x1: 0.34987
x2: 0.246853
x3: 0.513527
x4: 0.421378
x5: 0.188439
x6: 0.920897", "Arm 2_0
l2norm: 1.23998 (SEM: 0)
x1: 0.599525
x2: 0.498112
x3: 0.0586652
x4: 0.243652
x5: 0.752892
x6: 0.548049", "Arm 3_0
l2norm: 1.10127 (SEM: 0)
x1: 0.144057
x2: 0.655855
x3: 0.554914
x4: 0.568398
x5: 0.156581
x6: 0.326143", "Arm 4_0
l2norm: 1.11581 (SEM: 0)
x1: 0.0731118
x2: 0.294861
x3: 0.818363
x4: 0.644828
x5: 0.124673
x6: 0.227329", "Arm 5_0
l2norm: 1.62246 (SEM: 0)
x1: 0.684294
x2: 0.574683
x3: 0.314609
x4: 0.0422076
x5: 0.965861
x6: 0.894543", "Arm 6_0
l2norm: 1.78533 (SEM: 0)
x1: 0.999776
x2: 0.184601
x3: 0.642261
x4: 0.970265
x5: 0.518987
x6: 0.72836", "Arm 7_0
l2norm: 1.21408 (SEM: 0)
x1: 0.259457
x2: 0.965338
x3: 0.146016
x4: 0.342746
x5: 0.423651
x6: 0.395618", "Arm 8_0
l2norm: 1.16309 (SEM: 0)
x1: 0.318785
x2: 0.398165
x3: 0.737564
x4: 0.0746043
x5: 0.671853
x6: 0.302765", "Arm 9_0
l2norm: 1.54847 (SEM: 0)
x1: 0.921897
x2: 0.740425
x3: 0.241616
x4: 0.737369
x5: 0.263042
x6: 0.573013" ], "type": "scatter", "x": [ 0.48022231459617615, 0.7860641842707992, 0.2820129143074155, 0.6093457832528896, 0.5826958945887194, 0.644439499398482, 0.6817590308173282, 0.5264415604704081, 0.4759381777970646, 0.41481598700047884, 0.2345937784502794, 0.9839729340746999, 0.556047102066136, 0.6480627161529454, 0.41424281118440154, 0.5135274515719934, 0.05866516847163439, 0.5549135943874717, 0.8183632176369429, 0.31460949406027794, 0.642260979861021, 0.14601565711200237, 0.737563599832356, 0.24161582347005606 ], "xaxis": "x2", "y": [ 0.3874489367008209, 0.30629594065248966, 0.8816544087603688, 0.2632470597675328, 0.23556388286841093, 0.19396188032890765, 0.20589572746155044, 0.26515275439808467, 0.2816821438987053, 0.03440075213280118, 0.31739947386102607, 0.8005777131766081, 0.3062919819497732, 0.33496610505884356, 0.36021037987368987, 0.4213781486663478, 0.24365175049751997, 0.5683978386223316, 0.6448277672752738, 0.042207591235637665, 0.9702646033838391, 0.34274587221443653, 0.0746043473482132, 0.7373689478263259 ], "yaxis": "y2" } ], "layout": { "annotations": [ { "font": { "size": 14 }, "showarrow": false, "text": "Mean", "x": 0.25, "xanchor": "center", "xref": "paper", "y": 1, "yanchor": "bottom", "yref": "paper" }, { "font": { "size": 14 }, "showarrow": false, "text": "Standard Error", "x": 0.8, "xanchor": "center", "xref": "paper", "y": 1, "yanchor": "bottom", "yref": "paper" } ], "autosize": false, "height": 450, "hovermode": "closest", "legend": { "orientation": "h", "x": 0, "y": -0.25 }, "margin": { "b": 100, "l": 35, "pad": 0, "r": 35, "t": 35 }, "template": { "data": { "bar": [ { "error_x": { "color": "#2a3f5f" }, "error_y": { "color": "#2a3f5f" }, "marker": { "line": { "color": "#E5ECF6", "width": 0.5 }, "pattern": { "fillmode": "overlay", "size": 10, "solidity": 0.2 } }, "type": "bar" } ], "barpolar": [ { "marker": { "line": { "color": "#E5ECF6", "width": 0.5 }, "pattern": { "fillmode": "overlay", "size": 10, "solidity": 0.2 } }, "type": "barpolar" } ], "carpet": [ { "aaxis": { "endlinecolor": "#2a3f5f", "gridcolor": "white", "linecolor": "white", "minorgridcolor": "white", "startlinecolor": "#2a3f5f" }, "baxis": { "endlinecolor": "#2a3f5f", "gridcolor": "white", "linecolor": "white", "minorgridcolor": "white", "startlinecolor": "#2a3f5f" }, "type": "carpet" } ], "choropleth": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "type": "choropleth" } ], "contour": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "contour" } ], "contourcarpet": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "type": "contourcarpet" } ], "heatmap": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "heatmap" } ], "heatmapgl": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "heatmapgl" } ], "histogram": [ { "marker": { "pattern": { "fillmode": "overlay", "size": 10, "solidity": 0.2 } }, "type": "histogram" } ], "histogram2d": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "histogram2d" } ], "histogram2dcontour": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "histogram2dcontour" } ], "mesh3d": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "type": "mesh3d" } ], "parcoords": [ { "line": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "parcoords" } ], "pie": [ { "automargin": true, "type": "pie" } ], "scatter": [ { "fillpattern": { "fillmode": "overlay", "size": 10, "solidity": 0.2 }, "type": "scatter" } ], "scatter3d": [ { "line": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scatter3d" } ], "scattercarpet": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scattercarpet" } ], "scattergeo": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scattergeo" } ], "scattergl": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scattergl" } ], "scattermapbox": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scattermapbox" } ], "scatterpolar": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scatterpolar" } ], "scatterpolargl": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scatterpolargl" } ], "scatterternary": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scatterternary" } ], "surface": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "surface" } ], "table": [ { "cells": { "fill": { "color": "#EBF0F8" }, "line": { "color": "white" } }, "header": { "fill": { "color": "#C8D4E3" }, "line": { "color": "white" } }, "type": "table" } ] }, "layout": { "annotationdefaults": { "arrowcolor": "#2a3f5f", "arrowhead": 0, "arrowwidth": 1 }, "autotypenumbers": "strict", "coloraxis": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "colorscale": { "diverging": [ [ 0, "#8e0152" ], [ 0.1, "#c51b7d" ], [ 0.2, "#de77ae" ], [ 0.3, "#f1b6da" ], [ 0.4, "#fde0ef" ], [ 0.5, "#f7f7f7" ], [ 0.6, "#e6f5d0" ], [ 0.7, "#b8e186" ], [ 0.8, "#7fbc41" ], [ 0.9, "#4d9221" ], [ 1, "#276419" ] ], "sequential": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "sequentialminus": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ] }, "colorway": [ "#636efa", "#EF553B", "#00cc96", "#ab63fa", "#FFA15A", "#19d3f3", "#FF6692", "#B6E880", "#FF97FF", "#FECB52" ], "font": { "color": "#2a3f5f" }, "geo": { "bgcolor": "white", "lakecolor": "white", "landcolor": "#E5ECF6", "showlakes": true, "showland": true, "subunitcolor": "white" }, "hoverlabel": { "align": "left" }, "hovermode": "closest", "mapbox": { "style": "light" }, "paper_bgcolor": "white", "plot_bgcolor": "#E5ECF6", "polar": { "angularaxis": { "gridcolor": "white", "linecolor": "white", "ticks": "" }, "bgcolor": "#E5ECF6", "radialaxis": { "gridcolor": "white", "linecolor": "white", "ticks": "" } }, "scene": { "xaxis": { "backgroundcolor": "#E5ECF6", "gridcolor": "white", "gridwidth": 2, "linecolor": "white", "showbackground": true, "ticks": "", "zerolinecolor": "white" }, "yaxis": { "backgroundcolor": "#E5ECF6", "gridcolor": "white", "gridwidth": 2, "linecolor": "white", "showbackground": true, "ticks": "", "zerolinecolor": "white" }, "zaxis": { "backgroundcolor": "#E5ECF6", "gridcolor": "white", "gridwidth": 2, "linecolor": "white", "showbackground": true, "ticks": "", "zerolinecolor": "white" } }, "shapedefaults": { "line": { "color": "#2a3f5f" } }, "ternary": { "aaxis": { "gridcolor": "white", "linecolor": "white", "ticks": "" }, "baxis": { "gridcolor": "white", "linecolor": "white", "ticks": "" }, "bgcolor": "#E5ECF6", "caxis": { "gridcolor": "white", "linecolor": "white", "ticks": "" } }, "title": { "x": 0.05 }, "xaxis": { "automargin": true, "gridcolor": "white", "linecolor": "white", "ticks": "", "title": { "standoff": 15 }, "zerolinecolor": "white", "zerolinewidth": 2 }, "yaxis": { "automargin": true, "gridcolor": "white", "linecolor": "white", "ticks": "", "title": { "standoff": 15 }, "zerolinecolor": "white", "zerolinewidth": 2 } } }, "title": { "text": "l2norm" }, "width": 950, "xaxis": { "anchor": "y", "autorange": false, "domain": [ 0.05, 0.45 ], "exponentformat": "e", "range": [ 0.0, 1.0 ], "tickfont": { "size": 11 }, "tickmode": "auto", "title": { "text": "x3" }, "type": "linear" }, "xaxis2": { "anchor": "y2", "autorange": false, "domain": [ 0.6, 1 ], "exponentformat": "e", "range": [ 0.0, 1.0 ], "tickfont": { "size": 11 }, "tickmode": "auto", "title": { "text": "x3" }, "type": "linear" }, "yaxis": { "anchor": "x", "autorange": false, "domain": [ 0, 1 ], "exponentformat": "e", "range": [ 0.0, 1.0 ], "tickfont": { "size": 11 }, "tickmode": "auto", "title": { "text": "x4" }, "type": "linear" }, "yaxis2": { "anchor": "x2", "autorange": false, "domain": [ 0, 1 ], "exponentformat": "e", "range": [ 0.0, 1.0 ], "tickfont": { "size": 11 }, "tickmode": "auto", "type": "linear" } } }, "text/html": [ "
" ] }, "metadata": {}, "output_type": "display_data" } ], "source": [ "render(ax_client.get_contour_plot(param_x=\"x3\", param_y=\"x4\", metric_name=\"l2norm\"))" ] }, { "cell_type": "markdown", "id": "d6f843d5", "metadata": { "papermill": { "duration": 0.075096, "end_time": "2024-09-23T20:26:33.847380", "exception": false, "start_time": "2024-09-23T20:26:33.772284", "status": "completed" }, "tags": [] }, "source": [ "Here we plot the optimization trace, showing the progression of finding the point with the optimal objective:" ] }, { "cell_type": "code", "execution_count": 13, "id": "35ad5b62", "metadata": { "execution": { "iopub.execute_input": "2024-09-23T20:26:33.998930Z", "iopub.status.busy": "2024-09-23T20:26:33.998364Z", "iopub.status.idle": "2024-09-23T20:26:34.061380Z", "shell.execute_reply": "2024-09-23T20:26:34.060665Z" }, "papermill": { "duration": 0.140129, "end_time": "2024-09-23T20:26:34.062727", "exception": false, "start_time": "2024-09-23T20:26:33.922598", "status": "completed" }, "tags": [] }, "outputs": [ { "data": { "application/vnd.plotly.v1+json": { "config": { "linkText": "Export to plot.ly", "plotlyServerURL": "https://plot.ly", "showLink": false }, "data": [ { "hoverinfo": "none", "legendgroup": "", "line": { "width": 0 }, "mode": "lines", "showlegend": false, "type": "scatter", "x": [ 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 25 ], "y": [ -0.1326305694320895, -0.1326305694320895, -0.1326305694320895, -0.39007254621180587, -0.39007254621180587, -0.39007254621180587, -0.39007254621180587, -0.39007254621180587, -0.39007254621180587, -0.39007254621180587, -0.39007254621180587, -0.39007254621180587, -0.9394854515357067, -0.9394854515357067, -0.9394854515357067, -0.9394854515357067, -1.3971787160839368, -1.5232824160079845, -1.5232824160079845, -1.5232824160079845, -1.8384592079639135, -2.0475074022144875, -2.0475074022144875, -2.0475074022144875, -2.764156839536151 ] }, { "fill": "tonexty", "fillcolor": "rgba(128,177,211,0.3)", "legendgroup": "objective value", "line": { "color": "rgba(128,177,211,1)" }, "mode": "lines", "name": "objective value", "text": [ "
Parameterization:
x1: 0.4540459215641022
x2: 0.1083107516169548
x3: 0.48022231459617615
x4: 0.3874489367008209
x5: 0.35759443044662476
x6: 0.04704401642084122", "
Parameterization:
x1: 0.7877011969685555
x2: 0.7650168547406793
x3: 0.9839729340746999
x4: 0.8005777131766081
x5: 0.6997600067406893
x6: 0.8251022510230541", "
Parameterization:
x1: 0.5995250539854169
x2: 0.4981119902804494
x3: 0.05866516847163439
x4: 0.24365175049751997
x5: 0.7528919465839863
x6: 0.5480485809966922", "
Parameterization:
x1: 0.14405696280300617
x2: 0.6558552728965878
x3: 0.5549135943874717
x4: 0.5683978386223316
x5: 0.15658098179847002
x6: 0.3261430533602834", "
Parameterization:
x1: 0.07311184331774712
x2: 0.29486096929758787
x3: 0.8183632176369429
x4: 0.6448277672752738
x5: 0.12467342242598534
x6: 0.22732903808355331", "
Parameterization:
x1: 0.6842941446229815
x2: 0.5746827004477382
x3: 0.31460949406027794
x4: 0.042207591235637665
x5: 0.9658612506464124
x6: 0.8945432584732771", "
Parameterization:
x1: 0.9997762944549322
x2: 0.18460123147815466
x3: 0.642260979861021
x4: 0.9702646033838391
x5: 0.5189867494627833
x6: 0.7283596182242036", "
Parameterization:
x1: 0.259456948377192
x2: 0.965337953530252
x3: 0.14601565711200237
x4: 0.34274587221443653
x5: 0.4236511532217264
x6: 0.39561770763248205", "
Parameterization:
x1: 0.3187849810346961
x2: 0.39816474821418524
x3: 0.737563599832356
x4: 0.0746043473482132
x5: 0.6718525290489197
x6: 0.30276504810899496", "
Parameterization:
x1: 0.921897403895855
x2: 0.7404247587546706
x3: 0.24161582347005606
x4: 0.7373689478263259
x5: 0.2630415642634034
x6: 0.5730127999559045", "
Parameterization:
x1: 0.7377590881660581
x2: 0.00708171259611845
x3: 0.7860641842707992
x4: 0.30629594065248966
x5: 0.19055648054927588
x6: 0.8038020338863134", "
Parameterization:
x1: 0.004994632676243782
x2: 0.8503798572346568
x3: 0.2820129143074155
x4: 0.8816544087603688
x5: 0.8452220614999533
x6: 0.07408221065998077", "
Parameterization:
x1: 0.666758729350728
x2: 0.0
x3: 0.6093457832528896
x4: 0.2632470597675328
x5: 0.1421189638211514
x6: 0.6804781321847775", "
Parameterization:
x1: 0.41096009008537804
x2: 0.24062725975140511
x3: 0.5826958945887194
x4: 0.23556388286841093
x5: 0.03816260921337525
x6: 0.657492062589917", "
Parameterization:
x1: 0.7390386906926667
x2: 1.4827693682582122e-15
x3: 0.644439499398482
x4: 0.19396188032890765
x5: 0.10827907974019474
x6: 0.5768109400810664", "
Parameterization:
x1: 0.5437566721939686
x2: 0.0
x3: 0.6817590308173282
x4: 0.20589572746155044
x5: 0.0016254839128197237
x6: 0.7222850788844797", "
Parameterization:
x1: 0.5000967255291253
x2: 0.26775140552822324
x3: 0.5264415604704081
x4: 0.26515275439808467
x5: 0.13149819113637956
x6: 0.6189586076656854", "
Parameterization:
x1: 0.4398711592280446
x2: 0.4149794642859692
x3: 0.4759381777970646
x4: 0.2816821438987053
x5: 0.16113680806985006
x6: 0.7050046821203007", "
Parameterization:
x1: 0.4479953627357021
x2: 0.5569355970032126
x3: 0.41481598700047884
x4: 0.03440075213280118
x5: 0.1725246912748311
x6: 0.7505833874087792", "
Parameterization:
x1: 0.4485781356961192
x2: 0.6707134275175982
x3: 0.2345937784502794
x4: 0.31739947386102607
x5: 0.14489858846122186
x6: 0.5765685966768008", "
Parameterization:
x1: 0.4075112381562856
x2: 0.35199981901932564
x3: 0.556047102066136
x4: 0.3062919819497732
x5: 0.18265608121073956
x6: 0.7617131366005341", "
Parameterization:
x1: 0.3633820276811826
x2: 0.2567641575709474
x3: 0.6480627161529454
x4: 0.33496610505884356
x5: 0.20671411485641247
x6: 0.8178456315559102", "
Parameterization:
x1: 0.3309406515567845
x2: 0.18740872044416662
x3: 0.41424281118440154
x4: 0.36021037987368987
x5: 0.22629128865408102
x6: 0.8454203662122973", "
Parameterization:
x1: 0.34987031354732095
x2: 0.24685325432319488
x3: 0.5135274515719934
x4: 0.4213781486663478
x5: 0.1884387704824912
x6: 0.9208967975416132", "
Parameterization:
x1: 0.2922492680470685
x2: 0.1648603758054338
x3: 0.6048947574293929
x4: 0.28000064986759804
x5: 0.258434664163761
x6: 0.7556418914202201" ], "type": "scatter", "x": [ 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 25 ], "y": [ -0.1326305694320895, -0.1326305694320895, -0.1326305694320895, -0.39007254621180587, -0.39007254621180587, -0.39007254621180587, -0.39007254621180587, -0.39007254621180587, -0.39007254621180587, -0.39007254621180587, -0.39007254621180587, -0.39007254621180587, -0.9394854515357067, -0.9394854515357067, -0.9394854515357067, -0.9394854515357067, -1.3971787160839368, -1.5232824160079845, -1.5232824160079845, -1.5232824160079845, -1.8384592079639135, -2.0475074022144875, -2.0475074022144875, -2.0475074022144875, -2.764156839536151 ] }, { "fill": "tonexty", "fillcolor": "rgba(128,177,211,0.3)", "hoverinfo": "none", "legendgroup": "", "line": { "width": 0 }, "mode": "lines", "showlegend": false, "type": "scatter", "x": [ 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 25 ], "y": [ -0.1326305694320895, -0.1326305694320895, -0.1326305694320895, -0.39007254621180587, -0.39007254621180587, -0.39007254621180587, -0.39007254621180587, -0.39007254621180587, -0.39007254621180587, -0.39007254621180587, -0.39007254621180587, -0.39007254621180587, -0.9394854515357067, -0.9394854515357067, -0.9394854515357067, -0.9394854515357067, -1.3971787160839368, -1.5232824160079845, -1.5232824160079845, -1.5232824160079845, -1.8384592079639135, -2.0475074022144875, -2.0475074022144875, -2.0475074022144875, -2.764156839536151 ] }, { "line": { "color": "rgba(253,180,98,1)", "dash": "dash" }, "mode": "lines", "name": "Optimum", "type": "scatter", "x": [ 1, 25 ], "y": [ -3.32237, -3.32237 ] } ], "layout": { "showlegend": true, "template": { "data": { "bar": [ { "error_x": { "color": "#2a3f5f" }, "error_y": { "color": "#2a3f5f" }, "marker": { "line": { "color": "#E5ECF6", "width": 0.5 }, "pattern": { "fillmode": "overlay", "size": 10, "solidity": 0.2 } }, "type": "bar" } ], "barpolar": [ { "marker": { "line": { "color": "#E5ECF6", "width": 0.5 }, "pattern": { "fillmode": "overlay", "size": 10, "solidity": 0.2 } }, "type": "barpolar" } ], "carpet": [ { "aaxis": { "endlinecolor": "#2a3f5f", "gridcolor": "white", "linecolor": "white", "minorgridcolor": "white", "startlinecolor": "#2a3f5f" }, "baxis": { "endlinecolor": "#2a3f5f", "gridcolor": "white", "linecolor": "white", "minorgridcolor": "white", "startlinecolor": "#2a3f5f" }, "type": "carpet" } ], "choropleth": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "type": "choropleth" } ], "contour": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "contour" } ], "contourcarpet": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "type": "contourcarpet" } ], "heatmap": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "heatmap" } ], "heatmapgl": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "heatmapgl" } ], "histogram": [ { "marker": { "pattern": { "fillmode": "overlay", "size": 10, "solidity": 0.2 } }, "type": "histogram" } ], "histogram2d": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "histogram2d" } ], "histogram2dcontour": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "histogram2dcontour" } ], "mesh3d": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "type": "mesh3d" } ], "parcoords": [ { "line": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "parcoords" } ], "pie": [ { "automargin": true, "type": "pie" } ], "scatter": [ { "fillpattern": { "fillmode": "overlay", "size": 10, "solidity": 0.2 }, "type": "scatter" } ], "scatter3d": [ { "line": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scatter3d" } ], "scattercarpet": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scattercarpet" } ], "scattergeo": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scattergeo" } ], "scattergl": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scattergl" } ], "scattermapbox": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scattermapbox" } ], "scatterpolar": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scatterpolar" } ], "scatterpolargl": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scatterpolargl" } ], "scatterternary": [ { "marker": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "type": "scatterternary" } ], "surface": [ { "colorbar": { "outlinewidth": 0, "ticks": "" }, "colorscale": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "type": "surface" } ], "table": [ { "cells": { "fill": { "color": "#EBF0F8" }, "line": { "color": "white" } }, "header": { "fill": { "color": "#C8D4E3" }, "line": { "color": "white" } }, "type": "table" } ] }, "layout": { "annotationdefaults": { "arrowcolor": "#2a3f5f", "arrowhead": 0, "arrowwidth": 1 }, "autotypenumbers": "strict", "coloraxis": { "colorbar": { "outlinewidth": 0, "ticks": "" } }, "colorscale": { "diverging": [ [ 0, "#8e0152" ], [ 0.1, "#c51b7d" ], [ 0.2, "#de77ae" ], [ 0.3, "#f1b6da" ], [ 0.4, "#fde0ef" ], [ 0.5, "#f7f7f7" ], [ 0.6, "#e6f5d0" ], [ 0.7, "#b8e186" ], [ 0.8, "#7fbc41" ], [ 0.9, "#4d9221" ], [ 1, "#276419" ] ], "sequential": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ], "sequentialminus": [ [ 0.0, "#0d0887" ], [ 0.1111111111111111, "#46039f" ], [ 0.2222222222222222, "#7201a8" ], [ 0.3333333333333333, "#9c179e" ], [ 0.4444444444444444, "#bd3786" ], [ 0.5555555555555556, "#d8576b" ], [ 0.6666666666666666, "#ed7953" ], [ 0.7777777777777778, "#fb9f3a" ], [ 0.8888888888888888, "#fdca26" ], [ 1.0, "#f0f921" ] ] }, "colorway": [ "#636efa", "#EF553B", "#00cc96", "#ab63fa", "#FFA15A", "#19d3f3", "#FF6692", "#B6E880", "#FF97FF", "#FECB52" ], "font": { "color": "#2a3f5f" }, "geo": { "bgcolor": "white", "lakecolor": "white", "landcolor": "#E5ECF6", "showlakes": true, "showland": true, "subunitcolor": "white" }, "hoverlabel": { "align": "left" }, "hovermode": "closest", "mapbox": { "style": "light" }, "paper_bgcolor": "white", "plot_bgcolor": "#E5ECF6", "polar": { "angularaxis": { "gridcolor": "white", "linecolor": "white", "ticks": "" }, "bgcolor": "#E5ECF6", "radialaxis": { "gridcolor": "white", "linecolor": "white", "ticks": "" } }, "scene": { "xaxis": { "backgroundcolor": "#E5ECF6", "gridcolor": "white", "gridwidth": 2, "linecolor": "white", "showbackground": true, "ticks": "", "zerolinecolor": "white" }, "yaxis": { "backgroundcolor": "#E5ECF6", "gridcolor": "white", "gridwidth": 2, "linecolor": "white", "showbackground": true, "ticks": "", "zerolinecolor": "white" }, "zaxis": { "backgroundcolor": "#E5ECF6", "gridcolor": "white", "gridwidth": 2, "linecolor": "white", "showbackground": true, "ticks": "", "zerolinecolor": "white" } }, "shapedefaults": { "line": { "color": "#2a3f5f" } }, "ternary": { "aaxis": { "gridcolor": "white", "linecolor": "white", "ticks": "" }, "baxis": { "gridcolor": "white", "linecolor": "white", "ticks": "" }, "bgcolor": "#E5ECF6", "caxis": { "gridcolor": "white", "linecolor": "white", "ticks": "" } }, "title": { "x": 0.05 }, "xaxis": { "automargin": true, "gridcolor": "white", "linecolor": "white", "ticks": "", "title": { "standoff": 15 }, "zerolinecolor": "white", "zerolinewidth": 2 }, "yaxis": { "automargin": true, "gridcolor": "white", "linecolor": "white", "ticks": "", "title": { "standoff": 15 }, "zerolinecolor": "white", "zerolinewidth": 2 } } }, "title": { "text": "Best objective found vs. # of iterations" }, "xaxis": { "title": { "text": "Iteration" } }, "yaxis": { "title": { "text": "Hartmann6" } } } }, "text/html": [ "
" ] }, "metadata": {}, "output_type": "display_data" } ], "source": [ "render(\n", " ax_client.get_optimization_trace(objective_optimum=hartmann6.fmin)\n", ") # Objective_optimum is optional." ] }, { "cell_type": "markdown", "id": "908134ba", "metadata": { "papermill": { "duration": 0.079079, "end_time": "2024-09-23T20:26:34.221432", "exception": false, "start_time": "2024-09-23T20:26:34.142353", "status": "completed" }, "tags": [] }, "source": [ "## 7. Save / reload optimization to JSON / SQL\n", "We can serialize the state of optimization to JSON and save it to a `.json` file or save it to the SQL backend. For the former:" ] }, { "cell_type": "code", "execution_count": 14, "id": "9cd56cfe", "metadata": { "execution": { "iopub.execute_input": "2024-09-23T20:26:34.381109Z", "iopub.status.busy": "2024-09-23T20:26:34.380609Z", "iopub.status.idle": "2024-09-23T20:26:34.410970Z", "shell.execute_reply": "2024-09-23T20:26:34.410366Z" }, "papermill": { "duration": 0.111885, "end_time": "2024-09-23T20:26:34.412292", "exception": false, "start_time": "2024-09-23T20:26:34.300407", "status": "completed" }, "tags": [] }, "outputs": [ { "name": "stderr", "output_type": "stream", "text": [ "[INFO 09-23 20:26:34] ax.service.ax_client: Saved JSON-serialized state of optimization to `ax_client_snapshot.json`.\n" ] } ], "source": [ "ax_client.save_to_json_file() # For custom filepath, pass `filepath` argument." ] }, { "cell_type": "code", "execution_count": 15, "id": "d0830f2a", "metadata": { "execution": { "iopub.execute_input": "2024-09-23T20:26:34.579626Z", "iopub.status.busy": "2024-09-23T20:26:34.579147Z", "iopub.status.idle": "2024-09-23T20:26:34.695136Z", "shell.execute_reply": "2024-09-23T20:26:34.694538Z" }, "papermill": { "duration": 0.204994, "end_time": "2024-09-23T20:26:34.696540", "exception": false, "start_time": "2024-09-23T20:26:34.491546", "status": "completed" }, "tags": [] }, "outputs": [ { "name": "stderr", "output_type": "stream", "text": [ "[INFO 09-23 20:26:34] ax.service.ax_client: Starting optimization with verbose logging. To disable logging, set the `verbose_logging` argument to `False`. Note that float values in the logs are rounded to 6 decimal points.\n" ] } ], "source": [ "restored_ax_client = (\n", " AxClient.load_from_json_file()\n", ") # For custom filepath, pass `filepath` argument." ] }, { "cell_type": "markdown", "id": "e27fa2d8", "metadata": { "papermill": { "duration": 0.07927, "end_time": "2024-09-23T20:26:34.855006", "exception": false, "start_time": "2024-09-23T20:26:34.775736", "status": "completed" }, "tags": [] }, "source": [ "To store state of optimization to an SQL backend, first follow [setup instructions](https://ax.dev/docs/storage.html#sql) on Ax website." ] }, { "cell_type": "markdown", "id": "3ef59de9", "metadata": { "papermill": { "duration": 0.079088, "end_time": "2024-09-23T20:26:35.013275", "exception": false, "start_time": "2024-09-23T20:26:34.934187", "status": "completed" }, "tags": [] }, "source": [ "Having set up the SQL backend, pass `DBSettings` to `AxClient` on instantiation (note that `SQLAlchemy` dependency will have to be installed – for installation, refer to [optional dependencies](https://ax.dev/docs/installation.html#optional-dependencies) on Ax website):" ] }, { "cell_type": "code", "execution_count": 16, "id": "38a0c450", "metadata": { "execution": { "iopub.execute_input": "2024-09-23T20:26:35.173070Z", "iopub.status.busy": "2024-09-23T20:26:35.172563Z", "iopub.status.idle": "2024-09-23T20:26:35.182782Z", "shell.execute_reply": "2024-09-23T20:26:35.182255Z" }, "papermill": { "duration": 0.091918, "end_time": "2024-09-23T20:26:35.184127", "exception": false, "start_time": "2024-09-23T20:26:35.092209", "status": "completed" }, "tags": [] }, "outputs": [ { "name": "stderr", "output_type": "stream", "text": [ "[INFO 09-23 20:26:35] ax.service.ax_client: Starting optimization with verbose logging. To disable logging, set the `verbose_logging` argument to `False`. Note that float values in the logs are rounded to 6 decimal points.\n" ] } ], "source": [ "from ax.storage.sqa_store.structs import DBSettings\n", "\n", "# URL is of the form \"dialect+driver://username:password@host:port/database\".\n", "db_settings = DBSettings(url=\"sqlite:///foo.db\")\n", "# Instead of URL, can provide a `creator function`; can specify custom encoders/decoders if necessary.\n", "new_ax = AxClient(db_settings=db_settings)" ] }, { "cell_type": "markdown", "id": "b37b421c", "metadata": { "papermill": { "duration": 0.079796, "end_time": "2024-09-23T20:26:35.343278", "exception": false, "start_time": "2024-09-23T20:26:35.263482", "status": "completed" }, "tags": [] }, "source": [ "When valid `DBSettings` are passed into `AxClient`, a unique experiment name is a required argument (`name`) to `ax_client.create_experiment`. The **state of the optimization is auto-saved** any time it changes (i.e. a new trial is added or completed, etc). \n", "\n", "To reload an optimization state later, instantiate `AxClient` with the same `DBSettings` and use `ax_client.load_experiment_from_database(experiment_name=\"my_experiment\")`." ] }, { "cell_type": "markdown", "id": "ea3e3f98", "metadata": { "papermill": { "duration": 0.079024, "end_time": "2024-09-23T20:26:35.501679", "exception": false, "start_time": "2024-09-23T20:26:35.422655", "status": "completed" }, "tags": [] }, "source": [ "# Special Cases" ] }, { "cell_type": "markdown", "id": "5ba4e767", "metadata": { "papermill": { "duration": 0.078964, "end_time": "2024-09-23T20:26:35.660774", "exception": false, "start_time": "2024-09-23T20:26:35.581810", "status": "completed" }, "tags": [] }, "source": [ "**Evaluation failure**: should any optimization iterations fail during evaluation, `log_trial_failure` will ensure that the same trial is not proposed again." ] }, { "cell_type": "code", "execution_count": 17, "id": "afa8af92", "metadata": { "execution": { "iopub.execute_input": "2024-09-23T20:26:35.819750Z", "iopub.status.busy": "2024-09-23T20:26:35.819238Z", "iopub.status.idle": "2024-09-23T20:26:43.795100Z", "shell.execute_reply": "2024-09-23T20:26:43.794469Z" }, "papermill": { "duration": 8.057175, "end_time": "2024-09-23T20:26:43.796621", "exception": false, "start_time": "2024-09-23T20:26:35.739446", "status": "completed" }, "tags": [] }, "outputs": [ { "name": "stderr", "output_type": "stream", "text": [ "[INFO 09-23 20:26:43] ax.service.ax_client: Generated new trial 25 with parameters {'x1': 0.214511, 'x2': 0.142285, 'x3': 0.863297, 'x4': 0.230042, 'x5': 0.302497, 'x6': 0.688768} using model BoTorch.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 09-23 20:26:43] ax.service.ax_client: Registered failure of trial 25.\n" ] } ], "source": [ "_, trial_index = ax_client.get_next_trial()\n", "ax_client.log_trial_failure(trial_index=trial_index)" ] }, { "cell_type": "markdown", "id": "e985a9f4", "metadata": { "papermill": { "duration": 0.079702, "end_time": "2024-09-23T20:26:43.956539", "exception": false, "start_time": "2024-09-23T20:26:43.876837", "status": "completed" }, "tags": [] }, "source": [ "**Adding custom trials**: should there be need to evaluate a specific parameterization, `attach_trial` will add it to the experiment." ] }, { "cell_type": "code", "execution_count": 18, "id": "d816894c", "metadata": { "execution": { "iopub.execute_input": "2024-09-23T20:26:44.117469Z", "iopub.status.busy": "2024-09-23T20:26:44.116847Z", "iopub.status.idle": "2024-09-23T20:26:44.123348Z", "shell.execute_reply": "2024-09-23T20:26:44.122790Z" }, "papermill": { "duration": 0.088912, "end_time": "2024-09-23T20:26:44.124695", "exception": false, "start_time": "2024-09-23T20:26:44.035783", "status": "completed" }, "tags": [] }, "outputs": [ { "name": "stderr", "output_type": "stream", "text": [ "[INFO 09-23 20:26:44] ax.core.experiment: Attached custom parameterizations [{'x1': 0.9, 'x2': 0.9, 'x3': 0.9, 'x4': 0.9, 'x5': 0.9, 'x6': 0.9}] as trial 26.\n" ] }, { "data": { "text/plain": [ "({'x1': 0.9, 'x2': 0.9, 'x3': 0.9, 'x4': 0.9, 'x5': 0.9, 'x6': 0.9}, 26)" ] }, "execution_count": 18, "metadata": {}, "output_type": "execute_result" } ], "source": [ "ax_client.attach_trial(\n", " parameters={\"x1\": 0.9, \"x2\": 0.9, \"x3\": 0.9, \"x4\": 0.9, \"x5\": 0.9, \"x6\": 0.9}\n", ")" ] }, { "cell_type": "markdown", "id": "5ddb8d27", "metadata": { "papermill": { "duration": 0.080219, "end_time": "2024-09-23T20:26:44.285144", "exception": false, "start_time": "2024-09-23T20:26:44.204925", "status": "completed" }, "tags": [] }, "source": [ "**Need to run many trials in parallel**: for optimal results and optimization efficiency, we strongly recommend sequential optimization (generating a few trials, then waiting for them to be completed with evaluation data). However, if your use case needs to dispatch many trials in parallel before they are updated with data and you are running into the *\"All trials for current model have been generated, but not enough data has been observed to fit next model\"* error, instantiate `AxClient` as `AxClient(enforce_sequential_optimization=False)`." ] }, { "cell_type": "code", "execution_count": null, "id": "3043d909", "metadata": { "papermill": { "duration": 0.07952, "end_time": "2024-09-23T20:26:44.444244", "exception": false, "start_time": "2024-09-23T20:26:44.364724", "status": "completed" }, "tags": [] }, "outputs": [], "source": [] }, { "cell_type": "markdown", "id": "3c00f572", "metadata": { "papermill": { "duration": 0.079687, "end_time": "2024-09-23T20:26:44.602934", "exception": false, "start_time": "2024-09-23T20:26:44.523247", "status": "completed" }, "tags": [] }, "source": [ "**Nonlinear parameter constraints and/or constraints on non-Range parameters:** Ax parameter constraints can currently only support linear inequalities ([discussion](https://github.com/facebook/Ax/issues/153)). Users may be able to simulate this functionality, however, by substituting the following `evaluate` function for that defined in section 3 above." ] }, { "cell_type": "code", "execution_count": 19, "id": "3cb21272", "metadata": { "execution": { "iopub.execute_input": "2024-09-23T20:26:44.768119Z", "iopub.status.busy": "2024-09-23T20:26:44.767565Z", "iopub.status.idle": "2024-09-23T20:26:44.772238Z", "shell.execute_reply": "2024-09-23T20:26:44.771659Z" }, "papermill": { "duration": 0.087627, "end_time": "2024-09-23T20:26:44.773486", "exception": false, "start_time": "2024-09-23T20:26:44.685859", "status": "completed" }, "tags": [] }, "outputs": [], "source": [ "def evaluate(parameterization):\n", " x = np.array([parameterization.get(f\"x{i+1}\") for i in range(6)])\n", " # First calculate the nonlinear quantity to be constrained.\n", " l2norm = np.sqrt((x**2).sum())\n", " # Then define a constraint consistent with an outcome constraint on this experiment.\n", " if l2norm > 1.25:\n", " return {\"l2norm\": (l2norm, 0.0)}\n", " return {\"hartmann6\": (hartmann6(x), 0.0), \"l2norm\": (l2norm, 0.0)}" ] }, { "cell_type": "markdown", "id": "55704b53", "metadata": { "papermill": { "duration": 0.078993, "end_time": "2024-09-23T20:26:44.931591", "exception": false, "start_time": "2024-09-23T20:26:44.852598", "status": "completed" }, "tags": [] }, "source": [ "For this to work, the constraint quantity (`l2norm` in this case) should have a corresponding outcome constraint on the experiment. See the outcome_constraint arg to ax_client.create_experiment in section 2 above for how to specify outcome constraints.\n", "\n", "This setup accomplishes the following:\n", "1. Allows computation of an arbitrarily complex constraint value.\n", "2. Skips objective computation when the constraint is violated, useful when the objective is relatively expensive to compute.\n", "3. Constraint metric values are returned even when there is a violation. This helps the model understand + avoid constraint violations." ] }, { "cell_type": "markdown", "id": "3f186292", "metadata": { "papermill": { "duration": 0.078892, "end_time": "2024-09-23T20:26:45.089378", "exception": false, "start_time": "2024-09-23T20:26:45.010486", "status": "completed" }, "tags": [] }, "source": [ "# Service API Exceptions Meaning and Handling\n", "[**`DataRequiredError`**](https://ax.dev/api/exceptions.html#ax.exceptions.core.DataRequiredError): Ax generation strategy needs to be updated with more data to proceed to the next optimization model. When the optimization moves from initialization stage to the Bayesian optimization stage, the underlying BayesOpt model needs sufficient data to train. For optimal results and optimization efficiency (finding the optimal point in the least number of trials), we recommend sequential optimization (generating a few trials, then waiting for them to be completed with evaluation data). Therefore, the correct way to handle this exception is to wait until more trial evaluations complete and log their data via `ax_client.complete_trial(...)`. \n", "\n", "However, if there is strong need to generate more trials before more data is available, instantiate `AxClient` as `AxClient(enforce_sequential_optimization=False)`. With this setting, as many trials will be generated from the initialization stage as requested, and the optimization will move to the BayesOpt stage whenever enough trials are completed." ] }, { "cell_type": "markdown", "id": "4efc3e1d", "metadata": { "papermill": { "duration": 0.08018, "end_time": "2024-09-23T20:26:45.248985", "exception": false, "start_time": "2024-09-23T20:26:45.168805", "status": "completed" }, "tags": [] }, "source": [ "[**`MaxParallelismReachedException`**](https://ax.dev/api/modelbridge.html#ax.modelbridge.generation_strategy.MaxParallelismReachedException): generation strategy restricts the number of trials that can be ran simultaneously (to encourage sequential optimization), and the parallelism limit has been reached. The correct way to handle this exception is the same as `DataRequiredError` – to wait until more trial evluations complete and log their data via `ax_client.complete_trial(...)`.\n", " \n", "In some cases higher parallelism is important, so `enforce_sequential_optimization=False` kwarg to AxClient allows to suppress limiting of parallelism. It's also possible to override the default parallelism setting for all stages of the optimization by passing `choose_generation_strategy_kwargs` to `ax_client.create_experiment`:" ] }, { "cell_type": "code", "execution_count": 20, "id": "9c3ade9e", "metadata": { "execution": { "iopub.execute_input": "2024-09-23T20:26:45.410197Z", "iopub.status.busy": "2024-09-23T20:26:45.409714Z", "iopub.status.idle": "2024-09-23T20:26:45.420011Z", "shell.execute_reply": "2024-09-23T20:26:45.419323Z" }, "papermill": { "duration": 0.093156, "end_time": "2024-09-23T20:26:45.422164", "exception": false, "start_time": "2024-09-23T20:26:45.329008", "status": "completed" }, "tags": [] }, "outputs": [ { "name": "stderr", "output_type": "stream", "text": [ "[INFO 09-23 20:26:45] ax.service.ax_client: Starting optimization with verbose logging. To disable logging, set the `verbose_logging` argument to `False`. Note that float values in the logs are rounded to 6 decimal points.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 09-23 20:26:45] ax.service.utils.instantiation: Inferred value type of ParameterType.FLOAT for parameter x. If that is not the expected value type, you can explicitly specify 'value_type' ('int', 'float', 'bool' or 'str') in parameter dict.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 09-23 20:26:45] ax.service.utils.instantiation: Inferred value type of ParameterType.FLOAT for parameter y. If that is not the expected value type, you can explicitly specify 'value_type' ('int', 'float', 'bool' or 'str') in parameter dict.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 09-23 20:26:45] ax.service.utils.instantiation: Created search space: SearchSpace(parameters=[RangeParameter(name='x', parameter_type=FLOAT, range=[-5.0, 10.0]), RangeParameter(name='y', parameter_type=FLOAT, range=[0.0, 15.0])], parameter_constraints=[]).\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 09-23 20:26:45] ax.modelbridge.dispatch_utils: Using Models.BOTORCH_MODULAR since there is at least one ordered parameter and there are no unordered categorical parameters.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 09-23 20:26:45] ax.modelbridge.dispatch_utils: Calculating the number of remaining initialization trials based on num_initialization_trials=None max_initialization_trials=None num_tunable_parameters=2 num_trials=None use_batch_trials=False\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 09-23 20:26:45] ax.modelbridge.dispatch_utils: calculated num_initialization_trials=5\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 09-23 20:26:45] ax.modelbridge.dispatch_utils: num_completed_initialization_trials=0 num_remaining_initialization_trials=5\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 09-23 20:26:45] ax.modelbridge.dispatch_utils: `verbose`, `disable_progbar`, and `jit_compile` are not yet supported when using `choose_generation_strategy` with ModularBoTorchModel, dropping these arguments.\n" ] }, { "name": "stderr", "output_type": "stream", "text": [ "[INFO 09-23 20:26:45] ax.modelbridge.dispatch_utils: Using Bayesian Optimization generation strategy: GenerationStrategy(name='Sobol+BoTorch', steps=[Sobol for 5 trials, BoTorch for subsequent trials]). Iterations after 5 will take longer to generate due to model-fitting.\n" ] } ], "source": [ "ax_client = AxClient()\n", "ax_client.create_experiment(\n", " parameters=[\n", " {\"name\": \"x\", \"type\": \"range\", \"bounds\": [-5.0, 10.0]},\n", " {\"name\": \"y\", \"type\": \"range\", \"bounds\": [0.0, 15.0]},\n", " ],\n", " # Sets max parallelism to 10 for all steps of the generation strategy.\n", " choose_generation_strategy_kwargs={\"max_parallelism_override\": 10},\n", ")" ] }, { "cell_type": "code", "execution_count": 21, "id": "9ac2079b", "metadata": { "execution": { "iopub.execute_input": "2024-09-23T20:26:45.583467Z", "iopub.status.busy": "2024-09-23T20:26:45.583189Z", "iopub.status.idle": "2024-09-23T20:26:45.587977Z", "shell.execute_reply": "2024-09-23T20:26:45.587304Z" }, "papermill": { "duration": 0.086562, "end_time": "2024-09-23T20:26:45.589293", "exception": false, "start_time": "2024-09-23T20:26:45.502731", "status": "completed" }, "tags": [] }, "outputs": [ { "data": { "text/plain": [ "[(5, 10), (-1, 10)]" ] }, "execution_count": 21, "metadata": {}, "output_type": "execute_result" } ], "source": [ "ax_client.get_max_parallelism() # Max parallelism is now 10 for all stages of the optimization." ] } ], "metadata": { "kernelspec": { "display_name": "Python 3 (ipykernel)", "language": "python", "name": "python3" }, "language_info": { "codemirror_mode": { "name": "ipython", "version": 3 }, "file_extension": ".py", "mimetype": "text/x-python", "name": "python", "nbconvert_exporter": "python", "pygments_lexer": "ipython3", "version": "3.10.15" }, "papermill": { "default_parameters": {}, "duration": 133.47395, "end_time": "2024-09-23T20:26:47.928709", "environment_variables": {}, "exception": null, "input_path": "/tmp/tmp.QqcA7fo0ui/Ax-main/tutorials/gpei_hartmann_service.ipynb", "output_path": "/tmp/tmp.QqcA7fo0ui/Ax-main/tutorials/gpei_hartmann_service.ipynb", "parameters": {}, "start_time": "2024-09-23T20:24:34.454759", "version": "2.6.0" } }, "nbformat": 4, "nbformat_minor": 5 }