Drift Detection with WhyLabs

Monitor data drift and automate retraining triggers using WhyLabs integration in Valohai.

---

Overview

This example shows how to:

• Detect input data drift using WhyLabs

• Automate retraining pipelines upon drift detection

• Require human approval for retraining actions

The example shows how to do drift detection with WhyLabs, but the same approach can be used with other drift detection tools.

---

Steps

1

Setup a Training pipeline

Data is loaded from S3, preprocessed and saved as a Valohai dataset. Then using YOLO a model is trained and saved to Valohai

2

Setup a Drift Detection pipeline

Setup the pipeline for inference and log data to WhyLabs in order to detect drift.

3

Configure notifications for Approvals

As part of the drift detection pipeline you can include a notification and approval step to start a retraining of the model.

---

GitHub repository

The repository walks you through the steps above:

GitHub - valohai/drift-detection-exampleGitHub