During an execution, inputs are available under
/valohai/inputs/<input name>/<input file>.
To see this in action, try running
ls -la /valohai/inputs/ as the main command of execution which has inputs.
When you specify the actual input or default for one, you have 3 options:
Option #1: Custom Store URL¶
You can connect private data stores to Valohai projects.
If you connect a store that contains files that Valohai doesn’t know about, like the files that you have uploaded there yourself, you can use the following syntax to refer to the files.
- Azure Blob Storage:
- Google Storage:
- Amazon S3:
- OpenStack Swift:
This syntax also has supports wildcard syntax to download multiple files:
s3://my-bucket/dataset/images/*.jpgfor all .jpg (JPEG) files
s3://my-bucket/dataset/image-sets/**.jpgfor recursing subdirectories for all .jpg (JPEG) files
Option #2: Datum URI¶
You can use the
datum://<identifier> syntax to refer to specific files Valohai platform already knows about.
Files will have a datum URL if the files were uploaded to Valohai either:
- as outputs from another execution
- or using the Valohai web interface uploader under “Data” tab of the project
You can find the datum URL by clicking the “datum://” button under “Data” tab of the project.
Option #3: Public HTTP(S) URL¶
If your dataset is public and available through an HTTP(S) address, you can use that.