You can use
.vhignore to exclude files from your git repository that are uploaded to a worker instance. Since Git isn’t great for dealing with big files, we suggest putting them in a data store instead.
Commit Size Considerations
- Commits exceeding 100 MB can result in extended fetch times and potential timeouts within Valohai.
- If your repository contains large, non-essential files or directories for Valohai executions, you can use the
.vhignorefile to exclude them from being uploaded to the worker instance.
- Valohai imposes a maximum compressed commit size limit of 1 GB.
.vhignoreoperates similarly to
.gitignorein specifying files and directories to ignore.
- Files and directories defined in
.vhignorewon’t be transferred to the worker instance during execution.
- While Valohai can also understand
.gitignore, there are advantages to using
- Include large files and directories in version control but exclude them from executions.
- Even if a file or directory is already tracked by Git, you can exclude it using
.vhignore, providing greater flexibility.
# Ignore Mac system files .DS_store # Ignore my large files large-file-directory/ huge.tar.gz