Collect metadata¶

See also

This how-to is a part of our Bring your existing projects to Valohai series.

A short introduction metadata

Easily keep track of your executions key metrics and sort executions based on your custom metrics.
Anything that you print as JSON from your code gets collected as potential Valohai metadata.
Visualize and compare execution metrics as a timeseries, a scatter plot or a confusion matrix in the UI.
You can set early stopping rules for executions and Tasks or stop a pipeline from proceeding based on metadata values.
You can download the metadata as a CSV or JSON file from the executions metadata tab.

valohai-utils (Python)

import valohai

with valohai.metadata.logger() as logger:
    logger.log("epoch", epoch)
    logger.log("accuracy", accuracy)
    logger.log("loss", loss)

Python

import json

print()
print(json.dumps({
    "epoch": epoch,
    "accuracy": accuracy,
    "loss": loss
}))

library(jsonlite)

metadataEvent <- list()
metadataEvent[["epoch"]] <- epoch
metadataEvent[["accuracy"]] <- accuracy
metadataEvent[["loss"]] <- loss

write(toJSON(metadataEvent, auto_unbox=TRUE), stdout())