Grid Search

Experimenting with different hyperparameters individually can be a time-consuming process. Valohai simplifies hyperparameter tuning through parallel executions and grid searches.

When initiating a task, instead of specifying a single value for a single hyperparameter, you have the option to define multiple values simultaneously. Various modes are available for this purpose, including:

• Single: Assign a single value for the hyperparameter.
• Multiple: Define multiple specific values for the hyperparameter.
• Linear: Specify a range of values with linear spacing.
• Logspace: Define values in a logarithmic space.
• Random: Select values randomly within a specified range.

Create a Grid Search

From Git

Here’s how to create a Task for a grid search in Valohai:

1. Open your project in Valohai
2. Navigate to the Task tab.
3. Click “Create Task.”
4. Select the Step that contains the parameters you want to use for the grid search.
5. Scroll down to the “Parameters” section.
6. Choose “Grid search” as the Task type (this is the default).
7. Set the values for each parameter based on your search requirements.
8. For each parameter, choose the type from options like “Single,” “Multiple,” “Linear,” “Logspace,” or “Random.”
9. Input the corresponding values for the selected type (for multiple values, input one value per line).
10. Click on “Create task.”

From an adhoc execution

Here’s how to create a Task from an adhoc execution:

1. Open your project in Valohai
2. Open a completed execution
3. Click on the “Task” button, which is located in the top right corner of the details page.
4. Scroll down to the “Parameters” section.
5. Choose “Grid search” as the Task type (this is the default).
6. Set the values for each parameter based on your search requirements.
7. For each parameter, choose the type from options like “Single,” “Multiple,” “Linear,” “Logspace,” or “Random.”
8. Input the corresponding values for the selected type (for multiple values, input one value per line).
9. Click on “Create task.”