Tip
If you have any questions about the example projects or encounter any issues while running them, please contact us at support@valohai.com.
API Related
| Project | Description/Goal | GitHub Link |
|---|---|---|
| parallel-pipelines-api-example | Demonstrates how to use the Valohai API for running parallel pipelines. This example includes scripts and configurations to launch multiple pipelines simultaneously, showcasing Valohai’s capability to handle complex workflows efficiently. | Link |
| task-metrics-aggregator-example | Shows how to aggregate task metrics using Valohai. The project includes examples of collecting and aggregating metrics from different tasks to monitor and evaluate the performance of machine learning models effectively. | Link |
Model Training Related
| Project | Description/Goal | GitHub Link |
|---|---|---|
| alphafold-example | Showcases the usage of AlphaFold with Valohai for protein structure prediction. This project includes all necessary configurations and scripts to run AlphaFold models, making it easier to predict protein structures. | Link |
| distributed-llms-example | Provides an example of running distributed large language models (LLMs) on Valohai. The repository includes scripts and configurations for training and inference of LLMs across multiple nodes, optimizing computational resources. | Link |
| mistral-example | A Valohai example project for the Mistral model. It includes configurations and scripts to train and deploy the Mistral machine learning model, highlighting best practices for model management and deployment. | Link |
| gan-example | Demonstrates running Generative Adversarial Networks (GANs) on Valohai. This project provides an end-to-end pipeline for training GANs, including data preparation, model training, and result visualization. | Link |
| yolo-example | Provides an example project for running YOLO (You Only Look Once) on Valohai. It includes scripts and configurations for training and deploying YOLO models for real-time object detection tasks. | Link |
| tensorflow-example | Demonstrates using TensorFlow with Valohai. The project includes comprehensive examples of training, validating, and deploying TensorFlow models, showcasing Valohai’s integration with TensorFlow’s ecosystem. | Link |
| valohai-pytorch-lightning-example | Provides an example of using PyTorch Lightning with Valohai. This project simplifies the training of PyTorch models by leveraging PyTorch Lightning’s features for distributed training and automatic logging. | Link |
Data Management Related
| Project | Description/Goal | GitHub Link |
|---|---|---|
| feast-example | A Valohai example project for the Feast feature store. It includes examples of managing and serving machine learning features, integrating Valohai’s orchestration capabilities with Feast for streamlined data workflows. | Link |
Workflow and Pipeline Management
| Project | Description/Goal | GitHub Link |
|---|---|---|
| dynamic-pipelines-example | Demonstrates how to create dynamic pipelines with Valohai. This project includes scripts and configurations to build flexible and adaptive machine learning pipelines that can change based on input data and conditions. | Link |
| distributed-examples | Contains various examples of distributed computing on Valohai. This repository provides multiple scenarios and configurations for running distributed tasks, highlighting Valohai’s support for large-scale computations. | Link |
Monitoring and Drift Detection
| Project | Description/Goal | GitHub Link |
|---|---|---|
| drift-detection-example | Illustrates drift detection using Valohai. The project includes examples of monitoring model performance and detecting data drift, ensuring the reliability and accuracy of deployed models over time. | Link |