.vhignore

You can use .vhignore to exclude files from your git repository that are uploaded to a worker instance. Since Git isn’t great for dealing with big files, we suggest putting them in a data store instead.

Commit Size Considerations

• Commits exceeding 100 MB can result in extended fetch times and potential timeouts within Valohai.
• If your repository contains large, non-essential files or directories for Valohai executions, you can use the .vhignore file to exclude them from being uploaded to the worker instance.
• Valohai imposes a maximum compressed commit size limit of 1 GB.

Using .vhignore

• .vhignore operates similarly to .gitignore in specifying files and directories to ignore.
• Files and directories defined in .vhignore won’t be transferred to the worker instance during execution.
• While Valohai can also understand .gitignore, there are advantages to using .vhignore:
  • Include large files and directories in version control but exclude them from executions.
  • Even if a file or directory is already tracked by Git, you can exclude it using .vhignore, providing greater flexibility.

Example .vhignore

# Ignore Mac system files
.DS_store

# Ignore my large files
large-file-directory/
huge.tar.gz