In this guide, we’ll link an Oracle S3 bucket to a Valohai project.
Requirements
- An Oracle Cloud project that you can administer.
- A Valohai project or organization to link with the Oracle Bucket.
Create an Oracle Bucket
To set up a new bucket within the Oracle Cloud console, follow this official Oracle guide.
Once you have a bucket created, make a note of the namespace, this will be used as part of the endpoint URL of the bucket itself.
Generate access key
- Navigate to your Profile (click the top right person icon).
- Click My Profile.
- Navigate to customer secret keys.
- Click generate a secret key.
- Insert any name (make it memorable, as you will need to find the IAM ID later).
- Click generate a secret key.
- Copy the generated key.
Oracle S3 Endpoint
To point to your Oracle bucket, you will need the following information to build the correct endpoint:
- Namespace of your bucket.
- Region of your bucket.
The endpoint will look something like the following: https://NAMESPACE.compat.objectstorage.REGION.oraclecloud.com.
Link the Store to a Valohai Project
- Navigate to: Project -> Settings -> Data Stores -> Add Amazon S3.
- Store Name: use the same name as the Oracle bucket.
- Bucket Name: use the same name as the Oracle bucket.
- IAM Secret Access Key: paste in the previously generated secret key from Oracle.
- IAM Access Key ID: in Oracle, under ‘Customer secret keys’ find the key you just created. Under the column ‘Access key’, click the access key ID. Copy and paste this into Valohai.
- Check the box labeled
Use put_object for uploads
. - When you create the store, the credentials provided will be checked by creating a small test file in the bucket. If the creation succeeds, you are good to go.
- Once the data store is linked, you can set it as your project’s default upload store under Settings -> General -> Default upload store. This ensures that uploaded outputs will be stored in this particular Oracle S3 storage by default.